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v — "?This  report  describes  the  results  of  a  2-year  longitudinal  research  program 
to  assess  objectively  the  skill  retention  levels  of  relative]^  low  time  pri¬ 
vate  pilots.  Objectives  of  this  effort  were  to  identify  JJW  retention  pat¬ 
terns  for  skills  needed  to  perform  a  representati ve  range  of  private  pilot 
flight  tasks;  (0  factors  influencing  the  retention  of  these  skills  and  the 
nature  and  degree  of  such  influences;  and  continuation  training  methods 
to  maintain  or  upgrade  the  skills.  A  secondary  objective  was  to  assess 
pilots'  ability  to  predict  and  evaluate  their  own  proficiency  levelsy 

"^Results  are  summarized  for  flight  skill  retention  checks  conducted  8,  16,  and 
24  months  following  private  pilot  certification.  Proficiency  loss  was  docu¬ 
mented  for  all  subjects  and  for  each  flight  task  studied,  and  the  losses  were 
statistically  significant  in  nearly  all  cases.  Tasks  that  were  relatively 
high,  low,  and  more  rapid  in  skill  loss  were  identified,  and  the  effects  of 
interpolated  training  on  skill  loss  patterns  were  assessed.  Pilots'  ability 
tc  predict  and  evaluate  their  own  skill  retention  levels  for  specific  flight 
tasks  was  negligible.  The  present  findings  suggest  that  effective  con¬ 
tinuation  training  program  and  media  are  needed,  especially  to  address 
cognitive  types  of  flight  skills.  Several  such  potential  media  are 
described. 
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preface 


The  retention  of  pilot  flight  skills  is  a  critical  factor  in  the  overall 
safety  and  efficiency  of  general  aviation  operations.  Data  records  of  the 
National  Transportation  Safety  Board  indicate  that  the  problem  of  flight  skill 
retention  cunong  pilots  of  all  experience  levels  is  of  great  concern.  This 
final  report  describes  the  results  of  a  2-year  study  to  assess  objectively  the 
skill  retention  levels  of  relatively  inexperienced  private  pilots  8,  16,  and 
24  months  following  their  certification.  Interim  reports  of  this  project  sum¬ 
marized  the  assessments  of  8-month  and  16-month  skill  retention  (references  1 
and  2).  This  longitudinal  investigation  of  general  aviation  pilot  skill 
retention  was  sponsored  by  the  Federal  Aviation  Administration  (FAA)  Technical 
Center.  All  pilot  subjects  who  underwent  the  three  skill  retention  checkrides 
for  this  study  had  received  their  private  pilot  certificates  during  the  same 
period  of  time  as  part  of  an  earlier  FAA-sponsored  pioject  (reference  3).  The 
objective  in-flight  data  collection  instrument  used  to  gather  performance  data 
for  the  retention  checks  also  was  used  earlier  at  the  point  of  private  pilot 
certification,  thereby  enabling  meaningful  data  comparisons  to  be  made. 
Flight  skill  retention  checks  conducted  at  8-month  intervals  over  the  2-year 
period  helped  to  identify  the  specific  nature  and  degree  of  the  decrement 
function  that  occurs  for  infrequently  practiced  flight  skills.  Empirical  data 
stenming  from  these  checks  should  enable  more  valid  judgments  to  be  made  con¬ 
cerning  continuation  training  and  evaluation  requirements  for  general  aviation 
pilots.  In  the  present  study,  detailed  background  data  were  acquired  per¬ 
taining  to  subjects'  flying  activities  during  the  2-year  interval,  and  these 
data  were  related  to  measures  of  flight  proficiency  on  each  retention  check. 

This  flight  skill  retention  study  was  part  of  a  more  comprehensive  program  of 
research  sponsored  by  the  FAA  Technical  Center  and  designed  to  identify  and 
address  human  factors  problems  in  general  aviation.  Work  on  this  research 
program  was  accomplished  jointly  by  Embry-Ridd'le  Aeronautical  University 
(E-RAU)  and  the  Seville  Research  Corporation  under  Contract  No.  D0T-FA79NA- 
6040.  Seville's  activities  were  conducted  under  subcontract  to  E-RAU.  E-RAU 
provided  the  aircraft  and  checkpilot  for  this  study.  Seville  was  responsible 
for  development  of  the  measurement  instruments,  for  analysis  of  the  data,  and 
for  preparation  of  all  reports. 

t-RAU's  efforts  were  under  the  management  of  Ms.  Nena  Backer,  Coordinator, 
Aviation  Education  Design.  Seville's  program  management  was  provided  by 
Dr.  Wallace  W.  Prophet.  Dr.  Jerry  M.  Childs  was  Project  Director.  Technical 
assistance  for  this  report  was  provided  by  Drs.  William  D.  Spears  and 
Jack.  B.  Shelnutt,  and  by  Mr.  Winon  E.  Corley  of  Seville.  Mr.  Anthony  Frock, 
Mr.  Paul  Fink,  and  Mr.  Gregory  Lundberg  of  E-RAU  performed  many  of  the 
logistics  related  to  preparation  of  test  instruments,  scheduling  of  test  pro¬ 
cedures,  and  assistance  with  familiarization  flights.  Mr.  Guy  Adsit  served  as 
E-RAU 1 5  checkpilot  for  all  flight  checks.  He  was  responsible  not  only  for  all 
in-flight  data  collection,  but  also  assisted  in  scheduling  flight  checks  and 
administering  the  written  tests.  For  Seville,  Ms.  Faye  Sanders  performed  much 
of  the  data  reduction  and  collation,  and  Ms.  Carrie  Morris  served  as  Technical 
Editor.  The  Contracting  Officer's  Technical  Representative  for  the  FAA 


Technical  Center  originally  was  Mr.  Douglas  P.  Harvey.  He  was  succeeded  by 
Mr.  Robert  J.  Ontiveros.  They  provided  able  overall  cognizance  of  all  work 
activities  and  reviewed  drafts  not  only  of  this  technical  report,  but  others 
generated  as  part  of  the  more  comprehensive  research  program.  Their  efforts 
were,  in  all  respects,  supportive  and  helpful. 
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EXECUTIVE  SUMMARY 


INTRODUCTION. 

Flight  skills  will  degrade  over  time  if  not  exercised  sufficiently  for  the 
pilot  to  oe  able  to  retain  or  improve  them.  Thus,  pilots  who  do  not  fly  for 
extended  periods  of  time,  or  who  fail  to  practice  certain  critical  tasks  when 
they  do  fly,  may  be  expected  to  make  errors.  These  errors  can,  in  turn, 
contribute  to  a  variety  of  safety  problems  from  which  accidents  and  incidents 
iay  be  the  end  result. 

The  flying  skill  degradation  problem  can  he  addressed  through  effective  con¬ 
tinuation  training  programs.  Such  programs  should  be  implemented  cn  the  basis 
of  a  clear  perception  of  the  flight  skills  that  degrade  over  time  and  an 
understanding  of  the  factors  that  affect  this  degradation.  As  part  of  a 
research  program  sponsored  by  the  FAA,  the  present  study  was  designed  to  iden¬ 
tify  and  quantify  factors  that  affect  the  retention  of  flying  skills  by 
general  aviation  pilots  holding  the  private  pilot  certificate. 

The  pilot  proficiency  data  analyzed  in  the  present  study  were  collected  8,  16, 
and  24  months  after  the  subjects  received  their  certificate'.  All  data  could 
be  meaningfully  compared  since  flight  and  writtei  tests  usca  to  collect  the 
?kill  retention  data  were  identical  to  those  used  earlier  in  conj erection  with 
private  pilot  certification. 

Primary  objectives  of  this  study  were  (I)  to  identify  retention  patterns  for 
the  skills  needed  to  perform  the  various  contact  an u  basic  instrument  flight 
maneuvers  and  procedures  that  private  pilots  are  required  to  vi.-.t.er  for 
certification;  (2)  to  identify  factors  that  Influence  retent?o\  of  these 
skills  in  general  and  determine  the  specific  ways  in  hich  they  'in ferae  :  to 
influence  the  retention  of  different  skills;  and  (3)  to  develop  implications 
for  continuation  training  to  promote  skill  retention  among  general  aviation 
pilots.  A  secondary  objective  was  to  assess  the  ability  of  pilots  to  predict 
and  evaluate  their  own  proficiency. 

This  study  was  conducted  at  the  FAA  Technical  Center,  Atlantic  City  Airport, 
New  Jersey.  Subjects  were  personnel  employed  by  the  FAA.  Of  the  initial  42 
subjects,  2L  were  available  for  the  final  24-month  check.  At  the  time  of  the 
final  retention  check,  subjects  had  a  mean  of  162  total  flight  hours  (standard 
deviation  =  51  hours),  and  had  flown  a  mean  of  89  hours  (standard  deviation  = 
47  hours)  since  passing  their  private  pilot  flight  test.  Some  of  the  subjects 
had  received  additional  training  interpolated  between  their  private  pilot 
flight  test  and  the  various  retention  checks,  whereas  other  subjects  received 
no  such  interpolated  training. 

All  flight  proficiency  data  were  acquired  via  the  use  of  an  objective  in¬ 
flight  data  collection  instrument  containing  a  standard  sequence  of  flight 
tasks  to  be  administered  in  the  aircraft.  Error  percentages  on  tasks  con¬ 
tained  in  the  instrument  served  as  the  major  dependent  measure  of  skill 


retention.  However,  four  other  types  of  data  were  collected  on  each  subject. 
They  were: 

1.  survey  data  concerning  flying  activities  since  certification. 

2.  scores  on  an  adaptation  of  the  FAA  Private  Pilot  Written  Test. 

3.  precheck  (prediction)  questionnaire  data. 

4.  postcheck  (evaluation)  questionnaire  data. 

The  experimental  design  for  this  study  evolved  into  one  In  which  comparisons 
were  made  of  the  skill  retention  levels  of  the  subjects  who  underwent  inter¬ 
polated  instrument  training  during  the  24-month  interval  versus  those  subjects 
who  did  not. 

A  second  performance  comparison  was  derived  from  an  examination  of  when  inter¬ 
polated  training  was  received  relative  to  the  three  retention  checks.  This 
comparison  was  between  two  training  subgroups,  one  of  which  received  most  of 
its  interpolated  training  before  the  0-month  check  (Group  A),  and  the  other  of 
which  received  most  of  its  training  after  the  8-month  check  (Group  B) .  Thus, 
the  skill  retention  of  these  two  subgroups  and  that  of  the  no- training 
subgroup  (Group  C)  was  compared  across  flight  checks. 

RESULTS  AND  DISCUSSION. 

Data  were  analyzed  for  all  three  retention  checks  relative  to  private  pilot 
checkride  performance.  The  majority  of  flying  experience  acquired  by  subjects 
during  the  2-year  interval  occurred  in  conjunction  with  their  participation  in 
other  FAA-sponsored  training  research  projects.  At  the  time  of  the  24-month 
check,  a  mean  of  more  than  5  months  had  elapsed  since  subjects  had  flown,  and 
most  of  the  subjects’  additional  flying  experience  had  accrued  during  the 
initial  12  months  following  private  pilot  certification. 

General  decrement  in  performance  was  apparent  for  all  groups  as  represented  by 
the  decreases  iri  percentage  of  correctly  performed  measures  over  time.  With 
respect  to  combined  groups,  the  decrement  was  curvilinear  and  approximated  the 
classical  "forgetting  curve"  described  in  the  psychological  literature. 
However,  the  pattern  of  the  decrement  was  group-specific.  Group  A's  decrement 
was  delayed  by  the  effects  of  its  involvement  in  Interpolated  training 
occurring  during  the  initial  8-month  retention  interval.  Group  B  experienced 
substantial  decrement  initially  but  relatively  less  decrement  during  the 
second  8-month  interval  when  the  majority  of  its  interpolated  training  was 
received.  Group  C,  which  received  no  interpolated  training,  experienced 
virtually  all  of  its  skill  loss  during  the  first  3  months.  While  Group  A's 
decrement  was  relatively  less  than  that  of  Groups  B  and  C  during  the  first  8 
months,  the  decrement  was  statistically  significant  for  all  three  groups,  a 
finding  of  definite  operational  concern. 

Skill  decrement  over  the  24-morith  period  was  statistically  significant  for 
combined  flight  tasks,  as  well  as  for  each  task  considered  separately  (except 
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one  Involving  the  use  of  a  checklist).  Flight  tasks  exhibiting  the  greatest 
and  least  decrement  over  the  2-year  retention  interval  were  identified. 

Scores  on  written  examinations  significantly  decreased  over  the  initial 
8-month  period,  but  no  relationship  was  found  between  these  scores  and 
in-flight  error  rates  on  the  8-month  check. 

Subjects  demonstrated  a  moderate  ability  to  predict  and  evaluate  their  own 
overall  proficiency  at  the  8-month  check.  However,  they  were  not  accurate  in 
the  case  of  predictions/ evaluations  of  specific  flight  tasks. 

Results  of  the  present  study  strongly  indicate  that  private  pilots  who  do  not 
operate  aircraft  frequently  need  continuation  training  to  maintain  or  upgrade 
flight  skills.  To  attempt  to  identify  the  types  of  skills  that  degraded  in 
the  present  study,  an  exploratory  post  hoc  analysis  was  conducted  of  PPDR 
measures  performed  in  error.  This  analysis  revealed  that  cognitive/procedural 
components  were  frequently  performed  in  error  on  the  retention  checks.  For 
instance,  all  subjects  failed  to  acknowledge  at  least  one  ATC  instruction  at 
some  point  during  the  24-month  check,  and  70  percent  of  the  subjects  used 
improper  entry  procedures  for  one  or  more  of  the  stall  maneuvers.  Both  the 
general  literature  on  skill  retention  and  the  results  of  the  present  study 
suggest  that  generation  of  methods  to  improve  the  retention  of  cognitive 
skills  should  be  one  of  the  primary  objectives  of  continuation  training. 
General  aviation  continuation  training,  as  it  presently  exists,  does  not  suf¬ 
ficiently  address  the  coqni tive/procedural  types  of  skills  that  are  rather 
rapidly  lost  during  lapses  in  operations.  Several  continuation  training 

approaches  and  media  are  described  that,  are  potentially  useful  in  tne  aiding 
In  the  retention  of  cognitive  skills.  These  include  cognitive  training, 
various  training  devices,  and  full  mission  simulation.  Additionally,  criteria 
for  evaluating  the  usability  of  these  training  media  are  set  forth. 

CONCLUSIONS. 

Based  on  the  results  presented  and  the  discussion  and  implications  thereof,  a 
number  of  general  conclusions  can  be  drawn. 

1.  Recently  certificated  private  pilots  who  do  not  fly  regularly  can  be 

expected  to  undergo  a  relatively  rapid  and  significant  decrement  in  their 

flight  skills.  Further,  such  decrement  will  affect  most  flight  tasks  that  are 
required  of  the  private  pilot. 

2.  The  effect  of  interpolated  flight  training  is  to  forestall  (not 

prevent)  skill  decrement. 

3.  Instrument  training,  properly  conducted,  can  exert  positive  effects 
on  the  retention  of  both  contact  and  instrument  flight  tasks. 

4.  Greater  and  more  pervasive  performance  decrements  may  be  expected  for 

flight  tasks  that  require  appreciable  coordination  between  cognitive  and 

control  skills. 


5.  Written  test  (i.e.,  knowledge)  scores  decrease  significantly  during 
the  8-month  period  following  certification;  however,  written  test  scores  are 
not  useful  for  predicting  actual  flight  performance. 

6.  Private  pilots  who  do  not  fly  frequently  need  periodic  diagnostic 
assistance  to  help  them  pinpoint  specific  flight  tasks  on  which  they  need 
continuation  training. 

7.  Continuation  training  methods  should  be  skill- specific  and  emphasize 
the  development  and  reinforcement  of  cognitive  cues. 

8.  An  urgent  need  exists  for  the  development  of  more  effective  perfor¬ 
mance  criteria  and  of  continuation  training  methods  designed  to  aid  private 
pilots  in  meeting  those  criteria. 


x 


INTRODUCTION 


OVERVIEW. 

Flight  skills,  like  any  ccxnplex  skills,  will  degrade  over  time  if  not  exer¬ 
cised  sufficiently  for  the  pilot,  to  be  able  to  retain  or  improve  them.  Thus, 
when  pilots  do  not  fly  for  extended  periods  of  time,  their  flying  skills 
degrade,  and  they  often  will  make  errors  when  they  resume  flying.  Even  if 
pilots  fly  regularly,  their  skill  in  executing  flight  tasks  that  are  not  per¬ 
formed  frequently,  such  as  emergency  procedures,  still  may  degrade.  Flight 
tasks  that  are  performed  improperly  also  will  deteriorate,  and  if  consistently 
practiced  incorrectly,  undesirable  habit  patterns  will  result. 

The  nature  of  the  current  civil  aviation  accident  data  system  does  not  allow 
specific  determi nation  of  the  extent  to  which  flying  skill  degradation  may  be 
related  to  general  aviation  accidents.  However,  circumstantial  evidence, 
which  will  be  reviewed  later,  indicates  that  skill  degradation  should  be  con¬ 
sidered  a  serious  problem.  Further,  certain  trends  in  general  aviation  may 
exacerbate  this  problem  in  future  years.  Increasing  aircraft  operating  costs 
and  restrictions  on  general  aviation  flight  operations,  for  example,  have 
reduced  the  frequency  with  which  many  general  aviation  pilots  are  able  to  fly, 
particularly  pilots  who  fly  for  personal  business  and  recreational  purposes. 
Such  costs  and  restrictions  also  can  serve  to  reduce  the  amount  of 
continuation  training  that  even  pilots  who  fly  regularly  are  able  to  obtain. 

The  flying  skill  degradation  problem  can  only  be  addressed  through  effective 
continuation  training  programs.  To  be  effective--and  cost  efficient--such 
training  and  associated  pilot  proficiency  evaluations  should  focus  on  critical 
flight  skills  that  are  the  most  likely  to  degrade  over  time.  Research  on  the 
retention  of  flight  skills  and  other  complex  skills,  however,  has  shown  that  a 
number  of  factors  influence  the  way  in  which  different  skills  are  retained 
(references  4  through  7).  Thus,  knowledge  of  such  factors  and  the  way  they 
influence  the  specific  flying  skills  that  are  of  interest  is  a  necessary  pre¬ 
condition  for  determining  the  flight  tasks  that  should  be  evaluated  In 
recurrent  tests  of  pilot  proficiency,  and  that  should  be  included  in 
continuation  training. 

Because  of  its  continuing  concern  with  improving  the  safety  of  all  aspects  of 
general  aviation  operations,  the  Federal  Aviation  Administration  (FAA)  has 
conducted  a  variety  of  research  efforts  aimed  at  improving  airman  safety.  As 
one  of  such  efforts,  the  present  study  was  designed  to  aid  in  achieving  a 
better  understanding  of  factors  influencing  the  retention  of  flying  skills  by 
general  aviation  pilots  holding  the  private  pilot  certificate.  The  study  was 
part  of  a  2  1/2  year  investigation  sponsored  by  the  FAA  Technical  Center. 
During  the  initial  phase  of  this  investigation,  the  pilot  subjects  received 
the  training  necessary  to  qualify  for  the  private  pilot  certificate  (reference 
3),  and  were  tested  just  before  their  FAA  flight  check  using  an  objective 
flight  test,  a  written  test,  and  other  instruments  prepared  specifically  for 
the  present  investigation.  The  pilot  proficiency  data  analyzed  in  the  present 
study  were  collected  8,  16,  and  24  months  after  the  subjects  received  their 
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certificates.  The  same  flight  and  written  tests  were  used  to  collect  the 
skill  retention  data  as  were  used  in  conjunction  with  the  private  pilot  cer¬ 
tification.  Earlier  reports  in  this  project  described  retention  levels  at  8 
months  (reference  1)  and  at  16  months  (reference  2)  following  certi ficatlon. 
The  present  report  describes  the  extent  to  which  the  subjects  retained,  over 
the  24-month  period,  the  skills  necessary  to  perform  some  29  different  flight 
tasks,  further,  factors  affecting  the  retention  of  different  skills  are  iden¬ 
tified  and  analyzed  in  terms  of  their  influence  on  skill  retention  patterns. 

BACKGROUND  FOR  THE  PRESENT  STUDY. 

Impetus  for  assessing  the  retention  of  flying  skills  by  private  pilots  during 
the  early  years  fo' ’owing  their  certification  is  derived,  in  part,  from  the 
analysis  of  cert/..!  general  aviation  aircraft  accident  trends.  These  trends 
indicate  that  the  accident  rate  for  private  pilots  is  quite  high  iri  the  first 
>00  or  so  flight  hours  after  they  receive  their  private  pilot  certificate, 
particularly  for  certain  types  of  accidents.  For  example,  a  National 
Transportation  Safety  Board  (NTS8)  study  of  fatal  weather- rel ated  accidents 
occurring  from  1964  to  1972  found  that  such  accidents  were  approximately  twice 
is  prevalent  for  pilots  with  less  than  300  hours  of  total  flight  time  than  for 
those  with  more  than  3000  hours  of  experience  (reference  8).  A  study  of  non- 
fatal  weather- rel ated  accidents  occurring  from  1964  to  1974  found  an  even  more 
pronounced  trend;  approximately  92  percent  of  the  pilots  involved  in  these 
accidents  had  less  than  300  hours  of  total  flight  experience  (reference  9). 

Analyses  of  such  accident  data  are  confounded  somewhat  by  the  lack  of  exposure 
data--i.e.,  data  describing  the  number  of  hours  flown  each  year  by  pilots  with 
different  amounts  of  total  flight  experience--and  other  limitations  in  civil 
aviation  accident  data  systems.  Such  limitations  are  discussed  in  Connor  and 
Hamilton  (reference  10),  NTSB  (reference  11),  arid  Shelnutt,  Childs,  Prophet, 
and  Spears  (reference  12).  These  limitations  preclude  the  specific  deter¬ 
mination  of  the  severity  of  the  accident  problems  of  relatively  new  private 
pilots  (e.g.,  those  in  the  first  2-year  period  following  their  certification) 
in  comparison  with  that  of  pilots  with  greater  experience  (e.g.,  more  than 
2  years  since  certification).  However,  the  results  of  studies  cited  above  and 
analyses  of  data  summarized  in  NTSB  annual  reviews  of  general  aviation 
aircraft  accidents  reveal  that  a  continuing  high  percentage  of  the  general 
aviation  accidents  involve  private  pilots  with  100  to  300  total  flight  hours. 
In  some  years,  for  example,  such  accidents  have  accounted  for  over  30  percent 
jf  all  general  aviation  accidents.  Thus,  the  continuing  high  number  of  acci¬ 
dents  in  which  these  pilots  are  involved  provides  the  impetus  to  investigate 
factors  Influencing  their  performance. 

Obviously,  tne  accidents  in  which  these  pilots  have  been  involved  can  be 
attributed  to  many  causes  other  than  the  degradation  of  flying  skills. 
Unfortunately,  data  do  not  exist  for  any  group  of  pilots  that  can  be  used  to 
estimate  the  proportion  of  these  accidents  that  can  be  attributed  to  skill 
degradation  problems  as  opposed  to  other  causes.  The  lack  of  such  evidence  is 
due  to  limitations  in  the  way  in  which  data  concerning  all  pilot  performance 
problems  are  collected,  stored,  accessed,  and  analyzed  in  the  civil  aviation 
accident  data  systems.  Data  are  rarely  collected,  for  example,  concerning  the 
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specific  task(s)  on  which  a  general  aviation  pilot  may  have  erred  that  caused 
an  accident.  Further,  data  are  almost  never  collected  concerning  the 
frequency  and  recency  with  which  the  pilot  performed  the  task  in  question 
during  time  periods  recently  preceding  the  accident. 

Ci rcumstantial  evidence  can  be  assenbled,  however,  that  reveals  the  potential 
seriousness  of  the  skill  degradation  problem  for  all  general  aviation  pilots, 
regardless  of  the  amount  of  their  total  flight  experience.  For  example, 
several  analysts  investigating  the  circumstances  surrounding  a  number  of 
different  types  of  "pilot  error"  accidents  have  concluded  that  degradation  of 
flying  skills  was  a  factor  that  contributed  to  the  critical  pilot  performance 
problems  that  were  observed  (references  8,  9,  11,  and  13  through  20).  Some  of 
these  conclusions  were  based  on  observations  that  many  of  the  pilots  involved 
in  the  accidents  had  flown  infrequently  in  the  months  preceding  the  mishaps. 
In  other  studies,  the  conclusions  were  based  on  determi nations  that  many  of 
the  pilots  involved  in  the  mishaps  probably  had  not  recently  performed  or 
practiced  the  specific  tasks  on  which  they  had  erred. 

An  NTSB  study  of  accidents  following  engine  failures  on  light  twin-engine 
aircraft  furnishes  an  excellent  example  of  the  reasoning  underlying  the  latter 
type  of  conclusion  (reference  11).  A  major  finding  in  the  study  was  that  many 
of  these  accidents  indicated  a  lack  of  pilot  proficiency  in  managing  a  light 
twin  after  loss  of  power  in  one  engine.  The  data  indicated  that  these  acci¬ 
dents  often  involved  highly  experienced  pilots  (many  had  over  3000  total 
flight  hours)  as  well  as  inexperienced  pilots.  Some  of  the  accidents  could  be 
attributed  in  part  to  deficiencies  in  the  pilots'  original  multiengine 
training.  However,  based  on  reviews  of  the  accident  cases  in  which  the 
experienced  pilots  were  Involved  and  Interviews  with  a  number  of  general 
aviation  pilots,  the  Safety  Board  concluded  that  inadequacies  in  (or  lack  of) 
recurrent  training  for  skill  maintenance  might  be  more  important  as  a 
contributing  cause  than  the  level  of  initial  training. 

The  Safety  Board's  conclusion  implies,  as  does  common  sense,  that  the  pilot's 
ability  to  manage  the  aircraft  following  an  engine  failure  degrades  over  time 
if  the  pilot  does  not  practice  the  skills  required  for  safe  performance  of 
this  task.  It  is  reasonable  to  presume  that  pilots  infrequently  exercise 
these  skills  because  (1)  the  task  in  question  occurs  infrequently  in  routine 
flying  due  to  the  reliability  of  modern  aircraft  engines,  (2)  practice  of 
these  skills  is  inconvenient  and  expensive,  and  (3)  current  regulations 
governing  pilot  certification  do  not  specifically  require  such  practice. 
While  the  Safety  Board's  findings  pertain  specifically  only  to  those  accidents 
that  were  studied,  it  is  conceivable  that  similar  conditions  may  exist  for 
other  critical  flight  skills,  such  as  those  required  for  the  performance  of 
other  emergency  procedures. 

in  addition  to  indirect  evidence  from  accident  studies,  evidence  concerning 
the  skill  degradation  problem  also  can  be  derived  from  research  that  has  been 
conducted  on  the  retention  of  complex  skills  (reference  7).  Indeed,  an  exten¬ 
sive  amount  of  research  has  beeR  conducted  on  the  retention  and  forgetting  of 
flying  skills  in  particular  (references  4,  6,  and  21). 

While  most  of  this  research  has  been  in  military  aviation,  many  of  the 
findings  are  applicable  to  general  aviation.  The  general  pattern  for  the 
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degradation  of  most  complex  skills,  when  they  are  not  practiced,  is  a 
relatively  rapid  loss  of  proficiency  during  the  initial  part  of  the  retention 
period,  followed  by  a  relatively  slower  loss  over  time  of  skill  components  not 
originally  affected.  In  aviation,  this  general  pattern  has  been  found  con¬ 
sistently  in  research  on  pilots  with  various  levels  of  experience  and  com¬ 
petence.  bimply  put,  no  pilot  is  immune  to  the  loss  of  flying  skills  if  those 
skills  are  not  exercised.  Further,  much  of  the  loss  can  be  expected  to  occur 
in  the  initial  part  of  the  time  period  in  which  the  skills  are  not  exercised. 

The  specific  relation  between  loss  of  flying  skills  and  time,  however,  is 
determined  by  several  factors.  Such  factors  include,  for  example,  the  type  of 
task  that  is  being  performed,  the  original  level  of  the  pilot's  skill 
acquisition,  the  duration  of  the  time  period  since  the  pilot  received  initial 
training  on  the  task,  and  the  amount  and  type  of  flying  done  iri  the  interim 
period  since  the  skill  was  learned.  Given  the  number  of  factors  influencing 
skill  retention,  it  is  necessary  to  study  their  relative  effects  on  specific 
flying  skills  if  the  effects  of  skill  degradation  are  to  be  mitigated.  Thus, 
if  flying  skills  of  general  aviation  pilots  are  of  interest,  then  the  perfor¬ 
mance  of  these  pilots  should  be  studied.  Further,  various  types  of  piloting 
skills  (e.g.,  cognitive,  procedural,  or  motor)  may  be  expected  to  show 

differential  skill  loss  patterns  and,  thus,  should  be  specifically  studied. 

Unfortunately ,  there  have  been  very  few  skill  retention  studies  that  have 

focused  on  general  aviation  pilots.  The  studies  that  have  been  conducted, 
however,  reveal  that  skill  loss  can  be  a  problem  fur  many  of  them.  Seltzer 
(reference  22),  for  example,  performed  a  study  to  determine  the  effects  of 
calendar  time  since  certification  upon  the  retention  of  basic  instrument 

skills  by  noninstrument  rated  pilots.  (Contact  flight  skills  were  not  eval¬ 
uated  in  the  Seltzer  study.)  While  not  stated  explicitly  in  the  report,  it  is 
presumed  that  the  reason  for  focusing  on  instrument  skills  for  these  non¬ 

instrument  rated  pilots  was  to  address  an  amendment  to  Federal  Aviation 
Regulation  Part  61  that  requires  all  private  pilots  to  demonstrate  the  ability 
to  perform  basic  flight  maneuvers  solely  by  reference  to  flight  instruments. 
Since  noninstrument  rated  pilots  cannot  fly  solely  by  reference  to  instru¬ 
ments  in  normal  flight,  they  have  no  opportunity  to  exercise  their  instrument 
skills  other  than  to  practice  them  with  another  pilot  in  the  aircraft  or  on  an 
appropriate  training  device. 

The  performance  of  both  commercial  and  private  pilots  was  assessed  in  the 
Seltzer  ( reference  22)  study.  The  pilots  had  held  their  certificates  for 
periods  ranging  from  6  months  to  9  years.  In  his  report,  Seltzer  states  that 
the  results  of  the  study  indicated  that  there  was  a  discernible  loss  of 
Instrument  proficiency  since  certification  for  the  private  pilots.  The  rela¬ 
tionship  between  time  since  certification  and  skill  retention  was  low. 
However,  &  low  correlation  would  be  expected  if  loss  for  everyone  Is  fairly 
rapid.  The  lack  of  such  a  relationship  also  Implies  that  factors  other  than 
just  calendar  time  since  certification  were  more  dominant  in  determining  skill 
retention.  For  example,  skill  retention  scores  did  correlate  positively  with 
total  instrument  time  since  certification.  The  identification  of  such  other 
factors,  however,  was  confounded  by  certain  limitations  in  the  design  of  the 
study,  which  will  be  discussed  later. 
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A  study  by  Hollister,  LaPointe,  Oman,  and  Tole  (reference  23}  examined  the 
retention  of  both  contact  and  instrument  flying  skills  by  noninstrument  rated 
private  and  commercial  pilots.  A  wide  range  of  proficiency  was  observed  in 
the  subjects.  Three  experience  factors  accounted  for  some  25  percent  of  the 
variance  in  their  performance.  The  most  dominant  factor  was  recency,  which 
was  defined  as  the  average  rate  at  which  a  pilot  had  flown  since  certifica¬ 
tion.  The  logarithm  of  total  flight  time  was  the  second  most  important 
experience  factor.  The  logarithmic  relationship  was  due  to  the  finding  that 
changes  in  total  time  were  more  important  determinants  of  skill  retention  for 
pilots  with  low  total  time  than  for  those  with  higher  flying  time  accumula¬ 
tions  {a  finding  of  particular  interest  with  respect  to  the  objectives  of  the 
present  study).  Years  since  certification  was  the  third  most  important 
experience  factor. 

The  Hollister  et  al .  (reference  23)  study  also  found  that,  on  the  average, 
subjects  received  higher  scores  on  skills  employed  most  often  in  routine 
flights.  They  received  the  lowest  average  scores  on  skills  seldom  practiced, 
such  as  stalls  and  simulated  instrument  flight. 

As  a  consequence  of  the  research  and  other  circumstantial  evidence  described 
above,  a  recent  comprehensive  review  of  human  factors  problems  in  general 
aviation  (reference  12)  concluded  that  flying  skill  degradation  is  one  of  the 
most  critical  pilot  performance  problems  in  this  segment  of  civil  aviation. 
Further,  it  was  concluded  that  a  high  priority  should  be  given  to  improving 
continuation  training  programs  and  to  associated  programs  for  recurrently 
assessing  the  performance  of  general  aviation  pilots. 

At.  present,  a  number  of  programs  exist  to  encourage  general  aviation  pilots  to 
maintain  the  full  range  of  flying  skills  required  for  safe  flight.  Part  61.57 
of  the  Federal  Aviation  Regulations  specifies  general  currency  requirements 
for  a  limited  number  of  flight  tasks  (i.e.,  takeoffs,  landings,  instrument 
flights,  and  night  flights).  It  alsc  requires  that  general  aviation  pilots 
undergo  a  flight  review  every  24  months,  referred  to  as  the  Biennial  Flight 
Review  (BFR).  Additionally,  continuation  training  is  encouraged  by  FAA  and 
industry  programs  that  provide  nominal  awards  for  most  participants. 

Unlike  military  and  air  carrier  aviation,  however,  no  formal  mechanisms  exist 
whereby  general  aviation  pilots  are  required  to  receive  continuation  training 
on  specified  critical  skills.  Indeed,  recognition  of  the  need  for  con¬ 
tinuation  training  depends  primarily  on  the  ability  of  the  pilots  to  assess 
their  own  deficiencies,  and  whether  they  seek  refresher  training  depends  on 
their  motivation.  The  BFR  is  supposed  to  aid  the  pilot  in  this  task,  but 
guidelines  for  the  conduct  of  this  review  do  not  specify  which  flying  skills 
are  to  be  assessed.  Given  the  absence  of  such  guidance,  the  content  of  the 
BFR  varies  across  instructors,  and  some  critics  believe  that  it  does  not 
always  accomplish  its  desired  purpose  (references  24  and  25). 

To  be  efficient  and  effective,  recurrent  assessments  of  pilot  proficiency  and 
continuation  training  programs  should  focus  on  the  flying  skills  that  are 
critical  to  flight  safety  and  most  susceptible  to  degradation  over  time.  As 
stated  previously,  research  to  aid  in  identifying  these  flying  skills  needs  to 


be  specific  to  general  aviation.  Unfortunately,  most  of  the  research  on 
flying  skill  retention  has  not  been  in  general  aviation,  and  the  work  that  has 
been  done  in  this  segment  of  aviation  has  had  certain  limitations  that 
constrain  its  utility.  For  example,  neither  of  the  general  aviation  studies 
previously  cited  (references  22  and  23)  gathered  data  describing  the  level  of 
proficiency  that  the  subjects  had  attained  during  their  initial  training. 
Since  the  original  level  of  skill  acquisition  has  been  found  in  several  stu¬ 
dies  to  be  perhaps  the  most  dominant  single  factor  in  skill  retention 
(references  6  and  21),  the  lack  of  such  data  confounds  the  interpretation  of 
the  results  of  the  general  aviation  studies.  Subjects  may  have  performed 
poorly  on  a  given  task  during  the  retention  test  because  (1)  they  did  not 
learn  to  perform  it  well  enough  originally,  or  (2)  even  though  original 
learning  level  was  high,  they  failed  to  retain  it  well  over  time  for  other 
reasons.  Additionally,  neither  study  employed  objective  performance  measure¬ 
ment  instruments  (subjective  ratings  were  used),  and  neither  assessed  a  broad 
range  of  flight  tasks. 


diven  the  limitations  of  past  research  and  the  need  for  information  to  aid  in 
structuring  continuation  training,  there  is  a  need  for  further  research  to 
clarify  the  uncertainties  that  remain  regarding  the  retention  of  flying  skills 
by  general  aviation  pilots.  The  research  should  identify  factors  influencing 
the  way  different  skills  are  retained,  including  the  original  level  of  skill 
acquisition,  and  chart  the  influence  these  factors  have  over  time.  Further, 
since  the  ability  of  pilots  to  assess  deficiencies  In  their  own  skills  is  cri¬ 
tical  tu  the  effectiveness  of  current  continuation  training  practices,  this 
research  also  should  assess  the  accuracy  with  which  pilots  can  predict  and 
evaluate  their  ability  to  perform  specific  flight  tasks. 


OBJECTIVES. 

In  recognition  of  the  need  for  such  information,  the  present  study  was 
designed  to  accomplish  three  primary  objectives.  These  objectives  were  (1)  to 
identify  retention  patterns  for  the  skills  needed  to  perform  the  various  con¬ 
tact  and  basic  instrument  flight  maneuvers  and  procedures  that  private  pilots 
are  required  to  master  for  certification;  (2)  to  identify  factors  that 
influence  retention  of  these  skills  in  general  and  determine  the  specific  way 
in  which  they  interact  to  influence  the  retention  of  different  skills;  and  (3) 
to  develop  implications  for  continuation  training  to  promote  skill  retention 
among  general  aviation  pilots.  A  secondary  objective  was  to  assess  the 
ability  of  pilots  to  predict  and  evaluate  their  own  proficiency. 


METHOD 


EXPERIMENTAL  SETTING. 

This  study  was  conducted  at  the  FAA  iechnical  Center,  Atlantic  City  Airport, 
New  Jersey.  All  flight  tasks  were  performed  within  the  Atlantic  City 
operating  area.  The  checkpilot  and  aircraft  were  provided  by  Embry-Riddle 
Aeronautical  University  (E-RAU),  Daytona  Beach,  Florida. 
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SUBJECTS. 


Subjects  were  personnel  employed  by  the  FAA,  and  their  occupations  were  pre¬ 
dominantly  engineering  and  technical.  Forty- two  subjects  (including  4 
females)  began  this  skill  retention  study.  All  had  obtained  the  private  pilot 
certificate  as  a  result  of  their  participation  in  an  earlier  FAA-sponsored 
study  (reference  3).  Of  the  initial  42  subjects,  33  participated  in  the 
■j -month  check,  26  underwent  the  16-month  check,  and  21  were  available  for  the 
final  24-month  check.  Twenty  subjects  (including  1  female)  underwent  all  four 
checkrides.  Their  mean  age  was  34.8  years  (standard  deviation  =  7.3  years)  at 
the  time  of  t.he  24-month  retention  check.  Of  the  original  42  subjects,  26 
possessed  an  instrument  rating  as  a  result  of  their  recent  participation  in  an 
instrument  training  study  (reference  26).  Additionally,  24  subjects  acquired 
a  multi  engine  rating  during  the  retention  period  (reference  1).  At  the  time 
of  the  final  retention  check,  subjects  had  a  mean  of  162  total  flight  hours 
(standard  deviation  =  51  hours).  They  had  flown  a  mean  of  89  hours  (standard 
deviation  =  47  hours)  since  passing  their  private  pilot  flight  test  and  had 
operated  an  average  of  3.9  different  aircraft  (standard  deviation  =  2.0 
aircraft)  during  that  24-month  time  interval.  A  more  complete  summary 
description  of  these  background  data  is  found  in  the  RESULTS  section. 

CHECKP1L0T- 

The  retention  checkrides  were  conducted  oy  an  experienced  E-RAU  flight 
instructor  with  more  than  3000  hours  of  total  flight  time  and  almost  1500 
hours  of  dual  instruction  time.  His  responsibilities  were  to  administer  the 
retention  checks,  including  the  data  collection  instruments  described  below. 
Additionally,  he  recorded  all  in-flight  performance  data,  having  earlier  been 
trained  in  the  standard  use  of  the  objective  data  collection  instrument. 

AIRCRAFT. 


All  retention  checks  were  performed  in  comparably  equipped  Cessna  172 
aircraft,  the  same  type  as  that  used  in  subjects'  private  pilot  training. 

MEASURES  ACQUIRED. 

To  address  effectively  the  earlier  stated  research  objectives,  it  was 
necessary  to  gather  several  types  of  performance,  background,  and  knowledge 
data.  The  most  important  were  data  relating  to  in-flight  proficiency.  These 
data  were  acquired  via  the  use  of  a  Pilot  Performance  Description  Record 
(PPDR)  that  was  identical  in  content  and  sequence  to  that  employed  for  the 
private  pilot  flight  check.  (Additional  information  concerning  development  of 
the  PPDR  is  found  in  reference  3.)  Flight  tasks  included  in  the  PPDR  (Table  1 
and  Appendix  A)  are  the  same  ones  that  appeared  in  the  precheck  (prediction) 
and  postcheck  (evaluation)  questionnaires,  as  well  as  the  Private  Pilot 
Survey,  all  of  which  are  described  below. 
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TABLE  1.— PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR)  FLIGHT  TASKS 


Engine  Runup  and  Before 
Takeoff  Check 

Takeoff  and  Departure 

Short  Field  Takeoff 

Soft  Field  Takeoff 

Crosswind  Takeoff 

Straight  and  Level  Flight 

S  Turns  Across  a  Road 

Turns  About  a  Point 

Minimum  Controllable  Airspeed 

Takeoff  and  Departure  Stall 

Approach  to  Landing  Stall 

Engine  Failure  During  Flight 

Steep  Turns  (720°) 

Accelerated  Stall 

Rate  Climb  (Hood) 


Magnetic  Compass  Turn  (W-S;  270°) 
(Hood) 

Unusual  Attitude  Recovery  (Hood) 

180°  Turns  (Hood) 

VOR  Tracking  (Inbound  and  Outbound) 
Forced  Landing 

Traffic  Pattern  (Uncontrolled  Field) 
Traffic  Pattern  (Controlled  Field) 
Go-Around 

Landing  (Uncontrolled  Field) 

Landing  (Controlled  Field) 

Short  Field  Landing 
Crosswind  Landing 

Communications  (Airborne  and  Ground) 
Cross-Country  Planning 


The  PPDR  is  an  objective  in-flight  data  collection  instrument  containing  a 
standard  sequence  of  flight  tasks  to  be  administered  in  the  aircraft.  Tasks 
generally  are  selected  on  the  basis  of  operational  requirements.  Each  task 
contains  a  fixed  sequence  of  clearly  defined  segments  (where  applicable)  and 
flight  measures.  Objective  performance  indices  are  obtained  by  reference  to 
flight  status  indicators,  such  as  instrument  readings,  and  observable  visual 
referents  (e.g.,  runway  or  horizon)  outside  the  cockpit.  Performance  error  is 
defined  for  each  flight  measure  by  comparing  observed  values  or  states  with 
desired  values  or  states  at  designated  times  or  points.  Desired  values  and 
tolerance  levels  included  in  the  present  PPDR  were  defined  on  the  basis  of 
information  contained  in  the  following  documents: 

FAA  Private  Pilot  Flight  Test  Guide  (reference  28) 


Embry-Riddle  Aeronautical  University  Private  Pilot  Flight  Training 
Syllabus,  developed  earlier  for  the  skill  acquisition  study 
(reference  3) 
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Cessna  172  Information  Manual  (reference  28) 

The  Student  Pilots'  Flight  Manual  (reference  29) 

Flight  Training  Handbook  (reference  30) 

PPDR  measures  (such  as  airspeed,  heading,  turn  radius)  were  recorded  as  either 
"satisfactory"  or  as  an  "error."  If  a  given  measure  was  observed  to  be  within 
the  defined  tolerance  (e.g.,  desired  or  assigned  airspeed^  5  knots),  a  satis¬ 
factory  performance  was  recorded.  If  the  measure  was  performed  out  of 
tolerance,  an  error  was  recorded  for  that  measure.  As  noted  previously,  the 
checkpilot  had  received  indoctrination  training  concerning  PPDR  recording  pro¬ 
cedures,  as  well  as  what  constituted  satisfactory  and  error  performances  on 

the  various  PPDR  measures.  Each  PPDR  measure  and  its  error  parameters  were 

defined  in  a  handbook  (Appendix  A)  provided  to  the  checkpilot  at  the  beginning 
of  the  project.  To  ensure  complete  familiarization  with  the  standard 
recording  procedures,  practice  flights  were  made  by  the  checkpilot  both  during 
original  (certification)  training  and  prior  to  the  8-month  retention  check. 
During  these  practice  flights,  the  checkpilot  administered  each  PPDR  task  to  a 
manber  of  the  research  team  while  another  investigator  observed  from  the  back 
seat  of  the  aircraft. 

PPDR  measures  on  each  flight  task  were  transformed  into  error  percentages  for 

analyses.  That  is,  the  total  number  of  measures  that  were  in  error  for  a 

given  task  was  divided  hy  the  total  number  of  scored  measures  on  that  task  and 
multiplied  by  100.  These  error  percentages  (or  rates)  served  as  the  primary 
dependent  variable  in  assessing  private  pilot  flight  performance  and  skill 
retention.  (In  some  data  presentations  that  follow,  the  complement  of  error 
rate,  I.e.,  the  percentage  of  measures  correctly  perfoimed,  is  used.)  While 
error  rates  do  not  directly  reflect  error  "critical  i ty ,  experience  in  the  use 
of  the  PPDR  has  shown  that  error  rate  and  criticality  tend  to  be  correlated 
positively  (i.e.,  pilot  subjects  who  make  a  large  number  of  errors  tend  to 
make  critical  errors  as  well). 

The  PPDR  was  administered  for  the  private  pilot  checkride  as  well  as  each  of 
the  three  skill  retention  checks.  In  addition,  other  skill  and  knowledge 
indices  were  taken  on  the  private  pilot  and  8-month  checks.  One  of  these  con¬ 
sisted  of  scores  on  an  adaptation  of  the  FAA  Private  Pilot  Written  Test.  This 
test  was  generated  by  the  research  team  and  had  been  administered  (in  a  dif¬ 
ferent  form)  to  all  pilot  subjects  prior  to  their  private  pilot  flight  test. 
The  test  contained  60  multiple  choice  items  selected  randomly  from  a  pool  of 
600  items  and  was  scored  by  determining  the  percentage  of  correct  responses. 

Since  one  objective  of  this  study  was  to  determine  how  well  the  pilot  subjects 
could  predict  and  evaluate  their  own  flight  skills,  two  questionnaires  were 
administered  as  part  of  the  private  pilot  3nd  9-month  checks.  The  first 
(predi-cion)  questionnaire  was  completed  by  each  subject  just  prior  to  his  or 
her  retention  flight  check.  The  second  (evaluation)  questionnaire  was 
completed  by  each  subject  immediately  following  the  flight  check  before  any 
■  debriefs  n;;  oy  the  checkpilot.  Each  questionnaire  required  subjects  to  predict 
(or  evaluate)  their  proficiency  on  each  of  the  29  flight  tasks  in  Table  1. 
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These  questionnaires,  which  are  identical  except  for  instructions,  are  shown 
in  Appendix  B. 

Finally,  just  prior  to  all  three  of  the  retention  checks,  a  comprehensive 
pilot  survey  was  administered  to  each  subject.  This  survey  was  designed  to 
obtain  background  data  relating  to  the  subject's  flying  activities  during  the 
interval  since  obtaining  their  private  pilot  certificate.  These  data  were 
necessary  to  allow  effective  interpretation  of  the  PPDR  performance  data. 
Appendix  C  contains  this  survey. 

lo  summarise,  five  major  types  of  data  were  collected  on  each  subject.  They 
were; 


1.  PPDR  error  rates  on  29  flight  tasks  (all  three  retention  checks); 

2.  Private  Pilot  Survey  data  concerning  flying  activities  since 
certification  (all  three  retention  checks); 

3.  scores  on  an  adaptation  of  the  FAA  Private  Pilot  Written  Test  (8-month 
check  only); 

4.  precheck  (prediction)  questionnaire  data  (8-month  check  only);  and 

5.  postcheck  (evaluation)  questionnaire  data  (8-month  check  only). 

DATA  COLLECTION  PROCEDURES. 

Two  weeks  prior  to  each  retention  check,  subjects  were  notified  by  letter  that 
they  should  contact  a  designated  FAA  authority  to  schedule  their  retention 
checks.  The  29  flight  tasks  contained  in  the  PPDR  required  approximately  3 
hours  to  administer.  For  the  8-month  check  only,  it  was  not  considered 
feasible  to  acquire  all  written  and  flight  performance  data  during  the  same 
day,  since  such  a  procedure  would  have  interfered  with  the  subjects'  normal 
job  responsibilities.  Therefore,  two  sessions  were  scheduled  for  each  sub¬ 
ject.  The  first  session  was  devoted  to  the  private  pilot  written  test  only. 
The  second  was  employed  to  gather  the  rema’’nder  of  the  data.  During  the 
second  session,  each  subject  was  required  to  complete  the  following 
chronological  sequence  of  data  collection  activities: 

1.  undergo  checkpilot  briefing; 

2.  complete  the  Private  Pilot  Survey  (or  submit  survey,  if  already 
compl  eted) ; 

3.  complete  the  precheck  (prediction)  questionnaire; 

4.  prepare  a  cross-country  flight  plan; 

5.  undergo  the  flight  check; 
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6.  complete  the  post-check  (evaluation)  questionnaire;  and 

7.  undergo  checkpilot  debriefing. 

For  both  the  16-  and  24-month  retention  checks,  subjects  underwent  all  test 
procedures  in  a  single  session. 

EXPERIMENTAL  DESIGN. 

The  overall  design  of  this  study  provided  for  multiple  retention  checks  to  be 
administered  8,  16,  and  24  months  following  private  pilot  certification. 

Pilot  subjects  who  underwent  these  retention  checks  had  been  certificated  as 
part  of  an  earlier  study  to  determine  the  effects  of  two  distributions  of 
training  time  on  the  acquisition  of  private  pilot  flight  skills  (reference  3). 
Hence,  at  the  beginning  of  the  2-year  retention  period,  the  overall  training 
and  experience  level  of  subjects  was  relatively  homogeneous.  Further,  all 
subjects  had  received  their  certificates  within  the  same  general  calendar 
period  (December,  1980  -  August,  1981). 

Objective  baseline  PPDR  in-flight  performance  data  were  acquired  on  all  sub¬ 
jects  at  the  time  of  their  private  pilot  certification.  Types  of  data 
obtained  during  each  of  the  retention  checks  were  identical  in  nature  to  those 
acquired  earlier  at  the  time  of  certification,  and,  hence,  all  sets  of  data 
could  be  meaningfully  compared.  These  multiple  retention  checks  were 
considered  necessary  to  define  the  patterns  and  degree  of  flight  skill 
decrement  for  general  aviation  pilots  with  from  100  to  300  hours  of 
experience. 

As  with  most  studies  aimed  at  assessing  skill  retention  levels  over  extended 
time  periods,  it  was  not  possible  to  control  subjects'  activities  and 
experience  during  the  2-year  retention  interval.  How  much  or  how  often  sub¬ 
jects  flew,  the  type  of  flying  (e.g.,  training,  pleasure,  business)  they 
undertook,  if  any,  after  receiving  their  private  pilot  certificate,  and  other 
flyi ng- relevant  activities  would  likely  affect  skill  retention.  Thus,  several 
flight  experience  measures  were  acquired  on  each  subject  via  the  Private  Pilot 
Survey  (Appendix  C)  at  the  time  of  each  of  the  three  retention  checks.  These 
experience  measures  were  then  used  to  aid  in  Interpretation  of  subjects' 
proficiency  loss. 

This  retention  study,  as  initially  conceived  during  subjects'  private  pilot 
training,  employed  a  2  x  4  repeated  measures  design.  That  is,  the  retention 
performance  of  subjects  trained  under  one  or  the  other  of  two  private  pilot 
training  tracks  was  to  be  assessed  by  flight  checks  administered  at  four 
points  over  a  2-year  time  interval.  (The  two  private  pilot  training  programs 
differed  essentially  in  the  amount  of  calendar  time  involved,  one  being  about 
3  months  in  length,  while  the  other  was  about  6  months  [reference  3].)  The 
first  (baseline)  flight  check  was  to  occur  just  prior  to  private  pilot  cer¬ 
tification,  with  the  remaining  three  (retention)  checks  occurring  8,  16,  and 
24  months  after  certification. 

The  study,  as  carried  out,  employed  four  flight  checks  conducted  at  the  aboye 
designated  times.  However,  the  original  two-group  design  underwent 
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substantial  modification  because  of  differences  in  subjects'  flying 
activities.  Due  to  these  differences,  compari sons  between  the  original  two 
groups  trained  over  different  amounts  of  calendar  time  no  longer  were  meaning¬ 
ful  .  The  differences  v<ere  introduced  as  a  resu’t  of  subjects'  differential 
assignment  to  other  FAA  flight  training  programs.  Specifically,  some  subjects 
underwent  approximately  65  hours  of  instrument  and  multiengine  training 
(references  1  and  26)  during  the  retention  interval,  while  other  subjects  had 
no  interpolated  training  whatsoever.  The  majority  of  flight  time  acquired  by 
the  subjects  over  the  retention  interval  occurred  as  a  result  of  such  inter¬ 
polated  training.  Thus,  the  experimental  design  evolved  into  one  in  which 
comparisons  were  made  of  the  skill  retention  levels  of  the  subjects  who  under¬ 
went  interpolated  training  during  the  24-month  interval  versus  those  subjects 
who  did  not.  This  comparison  was  useful  from  an  operational  standpoint,  since 
it  is  known  that  many  “real-world"  private  pilots  continue  to  pursue 
additional  training  after  certification  while  others  do  not. 

A  second  performance  comparison  was  derived  from  an  examination  of  when  the 
interpolated  training  was  received  relative  to  the  retention  checks.  This 
comparison  was  between  two  training  subgroups,  one  of  which  received  most  of 
their  instrument  training  before  the  8-month  check,  and  the  other  of  which 
received  most  of  their  instrument  training  after  the  8-ntonth  check.  f.us,  the 
skill  retention  of  these  two  subgroups  and  that  of  the  no- training  subgroup 
was  compared,  not  only  for  the  8-month  check,  but  also  for  the  16-  and 
24-month  checks. 

To  summarize,  the  flight  performance  and  skill  retention  of  three  groups  of 
subjects  were  examined  at  private  pilot  certification  and  periodically  during 
a  2-year  period  thereafter  (i.e.,  at  the  8-,  16-,  and  24-month  points).  Two 
subject  groups  underwent  interpolated  training  (and  acquired  flying  time 
attendant  thereto),  while  the  third  group  did  not  undergo  such  training.  The 
interpolated  training  groups  differed  as  to  when  they  received  interpolated 
training  (i.e.,  one  group  mostly  before  the  8- month  retention  check  and  the 
other  group  mostly  after  that  check).  The  analyses,  therefore,  focused  not  on 
correlations  between  subjects'  flight  times  and  their  corresponding  profi¬ 
ciency  loss,  but  rather  on  whether  and  when  interpolated  training  occurred  and 
the  effects  of  such  training  on  retention  performance.  The  following  section 
describes  these  and  other  results  bearing  on  the  skill  retention  patterns 
observed  over  the  2-year  postcertification  interval. 


RESULTS 


FLIGHT  EXPERIENCE  DATA. 

Performance  and  written  data  were  analyzed  for  all  three  retention  checks 
relative  to  private  pilot  checkrlde  performance.  Descriptive  data  on 
subjects'  flight  experience  during  the  retention  interval  are  presented  In 
Table  2  to  provide  a  general  context  for  interpreting  the  nature  and  degree  of 
proficiency  loss  to  be  described.  Table  2  data  show  experience  levels  at  the 
time  of  the  24-month  retention  check  for  the  19  subjects  who  underwent  all 
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three  retention  checks,  (An  additional  6  subjects  underwent  two  of  three 
retention  checks,  while  another  8  subjects  took  one  retention  check.)  As 
earlier  noted,  the  majority  of  flying  experience  acquired  by  subjects  during 
the  2-year  interval  occurred  in  conjunction  with  their  participation  in  other 
FAA- sponsored  training  research  projects.  Specifically,  subjects  who  did  not 
participate  in  these  projects  accumulated  virtually  no  additional  flying 
experience  during  the  retention  irte,  al ,  and  participants  in  the  projects  had 
little  flying  experience  other  than  that  acquired  in  conjunction  with  their 
involvement  in  the  other  research  projects. 

The  recency  statistic  (Table  2)  indicates  that  at  the  time  of  the  24-month 
check,  a  mean  of  more  than  5  months  had  elapsed  since  subjects  had  flown. 
Only  three  subjects  had  flown  within  the  last  30  days  at  the  24-month  point. 
Thus,  most  of  the  subjects'  additional  flying  experience  had  accrued  during 
the  Initial  12  months  following  private  pilot  certification. 


TABLE  2. --SUBJECTS'  FLYING  ACTIVITY  DATA  AT  THE  TIME  OF 
THE  24-MONTH  RETENTION  CHECK  (N  =  19) 


MEAN 

SD 

lota!  Flight  Time  (Hours) 

162.3 

61.7 

Recency  (Days  Since  Last  Flight) 

167.0 

98.1 

FLIGHT  EXPERIENCE  SINCE  PRIVATE 

PILOT  CERTIFICATION 

Flight  Time  (Hours) 

89.1 

46.8 

Instrument  Training  (Hours) 

46.4 

14.1 

Multiengine  Training  (Hours) 

14.8 

6.2 

Hood  Time  (Hours) 

42.1 

15.3 

Dual  Time  (Hours) 

64.4 

35.1 

Simulator  Time  (Hours) 

29.2 

22.6 

Cross-Country  Time  (Hours) 

34.7 

30.0 

General  Aviation  Aircraft  Passenger 
Time  (Hours) 

10.9 

27.1 

General  Aviation  Aircraft  Types 

Flown  (Number) 

3.9 

2.0 

CLASSIFICATION  OF  GROUPS  BY  FLIGHT  EXPERIENCE. 


Preliminary  analyses  revealed  that  overall  retention  performance  was  markedly 
influenced  by  the  occurrence  of  instrument  training.  The  amount  of  training 
and  when  it  occurred  were  therefore  used  to  classify  subject  groups  for  the 
majority  of  the  analyses  of  performance  data.  Specifically,  subjects  were 
grouped  according  to  whether  they  received  most  of  their  instrument  training 
J)efore  the  8-month  check  (Group  A),  most  of  their  instrument  training  after 
the  "IT- mo  nth  check  (Group  B) ,  or  whether  they  received  no  instrument  Tor 
mul tiengine)  training  at  all  (Group  C) .  (Groups  A  and  B  received  approxi¬ 
mately  48  hours  of  Instrument  training.  Of  the  subjects  comprising  Groups  A 
and  B,  25  of  26  also  underwent  mul tiengine  training.  This  training  was  brief 
[approximately  15  hours]  and  occurred  during  a  relatively  homogeneous  time 
between  the  8-  and  16-month  checks.  Thus,  the  time  when  instrument  training 
occurred  was  the  principal  di fferentiating  factor  be twe en  G r  6  u ps  A  and  B.) 
Groups  A,  B,  and  C  contained  11,  15  and  10  subjects,  respectively ,  at  the  time 
of  the  private  pilot  check.  (Of  the  original  42  private  pilot  subjects,  6  did 
not  participate  in  any  of  the  retention  checks.) 

Group  A  accumulated  a  mean  of  40.1  hours  of  instrument  training  during  the 
initial  retention  period  before  the  8-month  check.  Group  B's  instrument 
training  mainly  occurred  between  the  8-  and  16-month  checks.  Thus,  Group  B 
had  a  mean  of  only  9.3  instrument  training  hours  prior  to  the  8-month  check. 
As  will  be  seen,  this  difference  in  instrument  training  significantly  affected 
the  performance  of  the  two  i roups . 

Figure  1  shows  the  flight  times  accumulated  by  each  of  the  three  groups  at  the 
point  at  which  they  underwent  their  retention  checks.  Note  that  the  times 
depicted  are  those  acquired  only  for  the  8  months  preceding  each  retention 
check  (i.e.,  times  are  not  cumulative).  Most  of  Group  A's  total  time  occurred 
during  the  interval  between  certification  and  the  8-rnonth  check,  and,  by 
contrast,  most  of  Group  B's  total  time  was  acquired  between  the  3™  and 
18-month  checks.  Further,  more  than  one-half  of  that  time  for  Groups  A  and  B 
resulted  from  instrument  training.  Both  groups  essentially  stopped  flying 
after  their  mul tiengine  training,  which  was  completed  just  prior  to  the 
IG-month  check.  This  cessation  of  flying  activity  for  Groups  A  and  B  is 
reflected  in  the  16-24  months  data  shown  in  Figure  1.  It  also  can  be  seen 
that  Group  G's  flying  times  were  low  over  the  entire  24-month  retention 
i  nterval . 

Points  made  earlier  are  clearly  apparent  in  Table  2  and  Figure  1:  (1)  most  of 
the  flight  experience  acqui red  by  subjects  was  i.i  conjunction  with  inter¬ 
polated  training;  (2)  substantial  variability  occurred  among  the  three  groups 
with  regard  to  flying  activities  during  the  retention  period;  and  (3)  subjects 
had  little  or  no  recent,  relevant  experience  when  they  underwent  the  24-month 
retention  check. 

FLIGHT  SKILL  RETENTION  AMONG  GROUPS. 

Figure  2  presents  group  flight  performance  curves  across  flight  checks.  The 
data  shown  here  are  in  terms  of  percentage  of  measures  correctly  performed, 
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GROUPS 


A  -  EARLY  INSTRUMENT-TRAINED  GROUP 
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FIGURE  1.— MEAN  FLIGHT  TIMES  OF  THE  GROUPS 
BY  8-MONTH  RETENTION  INTERVAL. 
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FIGURE  2. — MEAN  PERCENT  CORRECTLY  PERFORMED  MEASURES 
BY  GROUPS  ACROSS  FLIGHT  CHECKS. 


i.e.,  the  complement  of  error  percentage.  General  decrement  in  performance  is 
apparent  for  all  groups  as  represented  by  the  decreases  In  percentage  of 
correctly  performed  measures  over  time.  However,  the  pattern  of  the  decrement 
is  group- specific  and  requires  further  elaboration. 

Each  data  point  in  Figure  2  represents  all  subjects  within  a  group  who  under¬ 
went  a  given  flight  check.  It  should  TUe” noted  that  proficiency  declined  for 
each  group  from  any  given  flight  check  to  the  next. 

To  determine  the  significance  of  decrement,  statistical  tests  were  performed. 
Correlated  t  tests  were  computed  separately  for  each  group's  skill  decrement 
across  fl  igTit  checks.  That  is,  Group  A1  s  performance  on  the  private  pilot 
checkride  was  compared  with  its  own  performance  on  the  8-month  check.  Group 
A's  8-month  performance  was  compared  with  its  16-month  performance,  which,  in 
turn,  was  compared  with  its  24-month  performance.  These  within-group  statis¬ 
tical  comparisons  also  were  performed  for  flight  data  acquired  on  Groups  B  and 
C.  Table  3  presents  the  results  of  these  analyses.  The  numerical  values  In 
the  table  represent  the  increase  (or  in  one  instance,  decrease)  in  PPDR  error 
rate  (i.e.,  skill  loss)  for  pairs  of  designated  flight  checks,  the  number  of 
subjects  (£)  whose  performance  was  examined  on  both  of  those  flight  checks, 
and  the  statistical  significance  (p),  if  any,  of  the  proficiency  loss.  For 
example.  Group  A  (11  subjects)  showed  an  increase  in  error  rate  of  5.8  percent 
from  the  private  pilot  check  to  the  8-month  check,  and  this  increase  (i.e., 
skill  loss)  was  statistically  significant.  Croup  A  again  showed  a  statisti¬ 
cally  significant  skill  loss  from  the  8-  to  the  16-month  check,  but  the  loss 
between  the  16-  and  24-month  checks  was  not  statistically  significant  (ns). 
Table  3  depicts  sets  of  data  that  are  slightly  different  in  nature  from  the 
purely  descriptive  data  in  Figure  2.  Specifically,  data  points  in  Figure  2 
represent  the  total  number  of  subjects  in  each  group  who  underwent  a 
designated  flight  check.  However,  numerical  values  in  Table  3  represent  only 
the  number  of  subjects  who  underwent  both  of  a  given  pair  of  flight  checks. 
Thus,  Ns  comprising  the  Table  3  data  were  in  some  cases  smaller  than  those  for 
Figure  2,  and  the  means  differed. 


TABLE  3. --WITHIN-GROUP  SKILL  LOSS  ACROSS  FLIGHT  CHECKS 


GROUP 

PPC-8 

N 

m 

8-16 

N 

£ 

A 

5.8 

11 

<.01 

21.5 

6  <.001 

4.5 

6 

ns 

B 

20.3 

15 

<.001 

8.9 

12  <.05 

1.3 

11 

ns 

C 

26.6 

7 

<.001 

(1.5) 

4  ns 

(N  too  small) 

PPG:  Private  Pilot  Checkride 

8,  16,  24:  3-,  16-,  and  24-Month  Flight  Checks 


There  are  several  noteworthy  aspects  of  the  data  in  Figure  2  and  Table  3. 
First,  with  respect  to  all  three  groups,  proficiency  loss  was  substantially 
curvilinear  over  the  24-month  retention  interval.  That  is,  for  all  but  the  A 
group  who  received  interpolated  training  just  before  the  8-month  check,  most 
of  the  skill  decrement  occurred  during  the  initial  8  months,  a  moderate 
decranent  during  the  next  8-month  interval,  and  a  negligible  (and  statisti¬ 
cally  insignificant)  decrement  during  the  last  8-month  period.  Group  A  lost 
relatively  little  between  the  private  pilot  and  8-month  checks,  but  had  a 
rapid  loss  between  the  8-  and  16-month  checks,  a  finding  consistent  with  the 
pattern  of  rapid  loss  in  the  period  following  training  for  the  other  two 

groups.  As  such,  the  Figure  2  curves  depicting  performance  decranent  for  the 

three  groups,  particularly  for  Groups  B  and  C,  are  very  similar  in  form  to  the 
classical  "forgetting  curve"  described  in  the  psychological  literature.  It 
should  be  noted,  however,  that  these  data  reflect  total  or  overall  performance 
on  these  flight  checks,  and  that  the  individual  tasks  involved  may  show  quite 
different  and  idiosyncratic  trends. 

Second,  the  data  suggest  that  Group  C  experienced  virtually  all  of  its  skill 

loss  during  the  first  8  months,  while  the  early  loss  for  Groups  A  and  B  was 

mitigated  somewhat  by  the  additional  training  they  received  during  the  first 
16  months.  The  performance  of  Group  C  during  the  final  8  months  could  not  be 
meaningfully  compared  statistically  because  of  the  small  number  of  subjects 
involved.  Hence,  the  performance  decrement  shown  in  Figure  2  for  Group  C 
during  that  period  should  be  interpreted  with  caution. 

Third,  and  perhaps  most  important,  the  effects  of  the  different  points  at 
which  instrument  training  occurred  for  Groups  A  and  B  can  be  seen  in  the  data. 
Group  A  began  its  instrument  training  earlier  than  Group  B  and  had  some  40 
hours  of  such  training  (Figure  1)  completed  just  prior  to  the  8-month  reten¬ 
tion  check  (at  which  point  Group  B  had  just  begun  its  instrument  training). 
Skill  decrement  was  relatively  less  for  Group  A  than  for  Group  B  at  the 
0-month  check,  likely  reflecting  the  recency  of  Group  A' s  interpolated 
training.  In  contrast,  while  Group  B  received  considerably  more  interpolated 
training  between  the  8-  and  16-month  checks  than  did  Group  A,  it  did  not  work 
to  Group  B's  relative  advantage.  This  likely  resulted  from  the  fact  that  this 
training  occurred  soon  after  the  8-month  check,  but  relatively  long  before  the 
16-month  check.  "  ~J‘'~  ~~ 

It  appears  that  the  departure  of  Group  A  from  this  typical  forgetting  curve  Is 
entirely  due  to  the  interpolated  training  that  It  received  just  prior  to  the 
8-month  check.  One  test  of  this  hypothesis  consisted  of  assessing  the  error 
rates  of  the  two  groups  on  five  basic  instrument- rel ated  flight  tasks  con¬ 
tained  in  the  PPDR.  These  were  VOR  Tracking  and  four  tasks  performed  under 
the  hood;  Rate  Climb,  180°  Turn,  Magnetic  Compass  Turn,  and  Unusual  Attitude 
Recovery.  If  Group  A' s  instrument  training  just  prior  to  the  8-month  check 
benefited  it  on  that  check,  this  should  have  been  particularly  apparent  in  the 
form  of  lower  error  rates  on  the  above  tasks  relative  to  Group  B.  Examination 
of  mean  error  rates  on  the  tasks  confirmed  this  hypothesis.  Group  A's 
increase  in  error  rates  from  the  private  pilot  check  to  the  8-month  check  on 
the  five  instrument  tasks  av^aged  less  than  3  percent  (their  performance 
actually  improved  on  two  of  t>  .  tasks),  while  Group  B's  increases  in  error 
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rates  on  these  tasks  averaged  19  percent-  A  clear  advantage  is  therefore 
shown  for  Group  A  on  these  tasks,  and  the  advantage  might  have  been  greater  if 
not  for  the  brief  period  of  instrument  training  undergone  by  Group  B  just 
prior  to  th?  8-month  check. 

Even  stronger  support  for  this  hypothesis  canes  from  an  ex«ni nation  of  skill 
loss  for  the  two  groups  during  the  second  8-month  interval  (8-16  column  in 
Table  3).  Group  B,  which  underwent  approximately  40  hours  of  instrument 
training  during  this  interval,  exhibited  relatively  less  decrement  than  Group 
A  on  the  16--month  check,  an  almost  exact  reversal  of  the  effect  for  the 

8-month  check.  Group  A  then  experienced,  at  the  16-month  point,  a  major 
skill  decrenent  that  ostensibly  would  have  occurred  during  the  initial  8 
months  following  certification  had  it  not  received  the  majority  of  its  instru¬ 
ment  training  just  prior  to  the  8-month  check.  For  combined  groups,  the 
correlation  between  instrument  training  hours  and  errors  on  the  8-tnonth  check 
was  -.74.  That  is,  greater  instrument  training  experience  was,  to  a  substan¬ 
tial  degree,  associated  with  fewer  errors  (i.e.,  less  skill  decrement). 

Another  way  to  state  this  is  that  over  one- half  (54  percent)  of  the  perfor¬ 
mance  variance  in  the  8-month  check  error  rates  can  be  attributed  to  the 

incidence  of  instrument  training  during  that  interval. 

An  analysis  also  was  performed  on  flight  tasks  that  were  assessed  on  each 
retention  check  but  were  not  included  in  the  instrument  training  curriculum 
(reference  26).  This  was  done  to  determine  whether  the  earlier 
instrument  training  taken  by  Group  A  exerted  positive  8-month  retention 

effects  on  other  kinds  of  tasks.  Nine  tasks  were  identified  that  were  not 
practiced  during  instrument  training.  These  were:  Soft  Field  Takeoff, 

S  Turns  Across  a  Road,  Engine  Failure,  Takeoff  and  Departure  Stall, 
Accelerated  Stall,  Forced  Landing,  Traffic  Pattern  (Uncontrolled  Field), 
Landing  (Uncontrol  1 ed  Field),  and  Short  Field  Landing.  (While  these  are  pre¬ 
dominantly  contact  tasks,  some  contact  tasks  such  as  normal  takeoffs  and  lan¬ 
dings  are  nevertheless  routinely  performed  as  part  of  any  instrument  training 
program.)  If  the  benefits  of  instrument  training  extend  to  other  (non¬ 
instrument)  flight  tasks.  Group  A  should  have  lower  error  rates  than  Group  B 
on  the  above  tasks.  Again,  the  analysis  strongly  supported  the  beneficial 
effects  of  Group  A's  earlier  instrument  training  for  alleviating  skill  decre¬ 
ment,  Group  A's  error  rates  were  lower  than  those  of  Group  B  on  all  nine 
tasks,  and  the  differences  were  statistically  significant  on  six  of  them. 

These  analyses  suggest  that  flight  skills  decline  rather  rapidly  if  not  prac¬ 
ticed,  and  that  practice  on  certain  sets  of  tasks  may  transfer  positively  to 
other  task  sets.  In  the  present  case,  tasks  practiced  in  conjunction  with 
instrument  training  (i.e.,  instrument  tasks)  enhanced  performance  on  predomi¬ 
nantly  contact-oriented  tasks  as  well.  Neither  of  these  conclusions  is 
surprising  in  view  of  the  literature  documenting  the  beneficial  effects  of 
early  Instrument  training  (references  31  and  32),  and  studies  concerned  with 
skill  retention  (references  6,  7,  and  21). 

Due  to  the  observed  differences  in  amount  of  decrenent  among  groups,  signifi¬ 
cance  of  differences  between  groups  was  assessed  via  independent  t  tests.  As 
can  be  determined  from  Table  4  data.  Group  A  experienced  significantly  less 
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(p  <  .001)  decrement  in  their  flying  skills  during  the  initial  8-month  inter¬ 
val  following  certification  than  did  Group  B,  whose  skills  declined  appre- 
cl ably  during  this  interval.  In  contrast.  Group  A's  skill  decrement  was 
significantly  greater  (p  <  .01)  than  Group  B's  for  the  8-  to  16-month  inter¬ 
val.  Differences  between  the  two  groups  for  the  16-  to  24-month  interval  were 
not  statistically  significant. 


TABLE  4.— BETWEEN-GROUP  SKILL  LOSS  COMPARISONS 
(t  TESTS)  OVER  THE  THREE  RETENTION  INTERVALS 


GROUP 

COMPARISONS 

t 

PPC-8 

U 

P 

8-16 
t  N^ 

P 

t 

16-24 

N 

£ 

A  versus  B 

4.01 

25  p 

<.001 

3.20  19 

p  <  .01 

r 

0.69 

16 

ns 

B  versus  C 

1.34 

21 

ns 

★ 

* 

A  versus  C 

6.26 

17  p 

<.001 

1 

* 

i 

★ 

♦Insufficient  number  of  subjects  in  Group  C  for  reliable  comparisons. 


iroup  C's  skill  loss  was  significantly  greater  (p  <  .001)  than  Group  A's  for 
the  first  8  months,  but  was  not  significantly  greater  than  Group  B's.  Notice 
in  Figure  1  that  the  flying  times  for  both  Groups  B  and  C  were  low  as  compared 
to  Group  A  for  this  time  period.  While  the  number  of  Group  C  subjects  who 
participated  in  the  final  two  retention  checks  was  considered  too  small  for 
reliable  statistical  comparisons.  Figure  2  data  indicate  that  most  of  the 
skill  loss  documented  for  Group  C  had  occurred  by  the  initial  (8-month) 
retention  check. 

The  above  data  provide  additional  evidence  of  the  positive  effects  of  instru¬ 
ment  training  on  skill  retention.  Further,  the  lack  of  a  significant 
difference  between  Groups  A  and  B  in  skill  decrement  for  the  later  checks 
indicates  that  the  impa-~  of  instrument  training  dissipated  rapidly  in  the 
absence  of  other  ( nontraitii.ig)  experience.  Additional  flight  checks  would 
have  helped  to  define  asymp.  tic  levels  of  skill  loss  for  the  three  groups. 
However,  asymptotic  trends  are  apparent  in  Figure  2. 

RETENTION  OF  SPECIFIC  TASK  SKILLS. 

With  regard  to  proficiency  loss  for  specific  flight  tasks,  it  was  not  con¬ 
sidered  feasible  to  use  performance  data  from  the  8-month  retention  check  for 
statistical  analyses.  This  was  due  to  the  extreme  differences  that  occurred 
among  subjects  with  regard  to  their  experience  during  the  initial  retention 
interval.  In  effect,  for  Group  A,  and  to  some  extent  Group  B,  the  8-month 
check  did  not  constitute  a  retention  test  for  what  was  learned  during  private 
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pilot  training  as  much  as  a  test  of  training  iri  progress.  Thus,  the  only 
reasonable  means  for  making  statistical  comparisons  of  specific  task  skill 
retention  was  the  change  from  the  private  pilot  certification  check  to  the 
16-  and  24-month  retention  checks. 

As  with  analyses  for  combined  tasks,  the  measure  used  to  assess  skill  loss  on 
separate  tasks  was  PPDR  error  rate  (i.e.,  the  percentage  of  errors  occurring 
on  each  flight  task  across  all  standardized  flight  checks).  Two  tasks. 
Traffic  Pattern  at  Controlled  Fieiu.  and  Cross-Country  Planning,  were  excluded 
fran  the  analyses  because  of  data  anomalies.  (For  Traffic  Patterns  at 
Controlled  Fields,  not  enough  cases  were  available  for  meaningful  analyses. 
Cross-country  Planning  showed  highly  irregular  error  patterns  across  flight 
checks.) 

Table  5  shows  the  mean  percentages  of  correct  performance  across  flight  checks 
for  the  27  flight  tasks  analyzed.  Figure  3  depicts  the  same  measure  for 
combined  tasks  across  flight,  checks  (including  the  8-month  check).  (While 
performance  data  from  the  8-month  check  were  not  used  in  statistical  com¬ 
parisons,  they  are  included  in  Figure  3  and  Table  6  for  descriptive  purposes 
Dnly. 

3KILL  LOSS  ON  FLIGHT  TASKS  AT  16  MONTHS.  All  flight  tasks  considered,  the 
nean  PPDR  error  rate  Tand  standard  deviation)  on  the  private  pilot  flight 
;heck  was  3.9  percent  (6.9).  The  16-month  retention  check  produced  a  mean 
error  rate  (and  standard  deviation)  of  38.1  percent  (15.3).  The  mean  (and 
standard  deviation)  for  overall  skill  loss,  as  defined  by  error  rate  incre¬ 
ments  across  the  16-month  interval  was,  therefore,  29.2  percent  (11.1).  Such 
loss  is  statistically  reliable  (p  <  .01).  Error  rates  increased  for  all 
except  1  of  the  27  flight  tasks  assessed.  That  task,  Engine  Runup  and  Before 
Takeoff  Check,  was  the  only  one  that  involved  the  use  of  a  checkiist.  Thus, 
if  subjects  could  renember  to  consult  the  checklist  (all  did  on  both  flight 
checks),  error- free  performance  was  virtually  assured. 

The  upper  portion  of  Figure  4  shows  the  flight  tasks  that  underwent  the 
greatest  absolute  decline  in  performance  (as  represented  by  mean  increase  in 
error  rate)  during  the  16-month  interval.  (As  previously  noted,  individual 
task  analyses  were  not  made  at  the  8-month  check  point  because  of  subject 
experience  variability.)  The  mean  skill  decrement  for  these  six  tasks  was 
42.8  percent.  Flight  tasks  that  denonstrated  the  least  amount  of  absolute 
decrement  are  shown  in  the  lower  portion  of  the  figure.  The  mean  decrement 
over  the  16-month  interval  for  these  five  tasks  was  6.8  percent. 

It  was  reasonable  to  presume  that  the  substantial  difference  in  skill  loss 
that  characterizes  the  two  groups  of  flight  tasks  might  be  partially  attrib¬ 
uted  to  how  frequently  they  were  performed  during  the  retention  Interval  and, 
perhaps,  to  their  level  of  difficulty.  This  hypothesis  was  generally  sup¬ 
ported  by  analyses  of  survey  data.  Survey  data  indicated  that  high  skill  loss 
tasks  were  performed,  on  the  average,  during  only  approximately  3C  percent  of 
subjects'  flights  over  the  16-month  retention  Interval,  while  low  skill  loss 
tasks  were  performed  during  approximately  70  percent  of  those  fl  ights. 
(Survey  data  indicated  that  the  mean  rumber  of  flights  taken  by  subjects 
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ABLE  5. --MEAN  PERCENT  CORRECTLY  PERFORMED  MEASURES  FOR  EACH 
FLIGHT  TASK  ACROSS  FLIGHT  CHECKS 


TASKS 


FLIGHT  CHECK 

PRIVATE 

PILOT  8-MOS .  16-MOS.  24-MOS. 


1.  Engine  Runup/Befc-e  Takeoff  Check 

2.  Takeoff  and  Departure 
3-  VOR  Tracking 

4.  Straight  and  Level 

5.  Minimum  Controllable  Airspeed 

6.  Takeoff  and  Departure  Stall 

7.  Approach  Stall 

8.  Steep  Turns 

9.  Accelerated  Stall 

10.  Engine  Failure  During  Flight 

11.  Forced  Landing 

12.  Traffic  Pattern  (Uncontrolled  Field) 

13.  Landing  (Uncontrolled  Field) 

14.  Short  Field  Takeoff 

15.  Short  Field  Landing 

16.  Soft  Field  Takeoff 

17.  Crosswind  Takeoff 

18.  Crosswind  Landing 

19.  S  Turns  Across  a  Road 

20.  Turns  About  a  Point 

21.  Rate  Climb  (Hood) 

22.  Magnetic  Compass  Turn  (Hood) 

23.  Unusual  Attitude  Recovery  (Hood) 

24.  180°  Turns  (Hood) 

25.  Go-Around 

26.  Landing  (Controlled  Field) 

27.  Communications 


00 

98 

100 

95 

74 

64 

79 

68 

48 

TABLE  6. --COMPOSITE  SKILL  LOSS  FOR  FLIGHT  TASKS  OVER 
THE  2-YEAR  PERIOD  (LOWEST  RANK  =  GREATEST  SKILL  LOSS) 


1.  Landing  (Uncontrolled  Field) 

2.  Traffic  Pattern  (Uncontrolled  Field) 

3.  Short  Field  Landing 

4.  Accelerated  Stall 

5.  Steep  Turns 

6.  S  Turns  Across  a  Road 

7.  Turns  About  a  Point 

8.  Rate  Climb  (Hood) 

9.  Magnetic  Compass  Turn  (Hood) 

10.  Minimum  Controllable  Airspeed 

11.  Short  Field  Takeoff 

12.  Crcsswind  Landing 

13.  Landing  (Controlled  Field) 

14.  VOR  Tracking 

15.  Crosswind  Takeoff 

16.  180°  Turn  (Hood) 

17.  Normal  Takeoff  and  Departure 

18.  Soft  Field  Takeoff 

19.  Unusual  Attitude  Recovery  (Hood) 

20.  Takeoff/Departure  Stall 

21.  Forced  Landing 

22.  Straight  and  Level 

23.  Approach  Stall 

24.  Communications 

25.  Engine  Failure 

26.  Go-Around 

27.  Engine  Runup/Before  Takeoff  Check 


24 


ACCELERATED  STALL 


TRAFFIC  PATTERN 
(UNCONTROLLED  FIELD) 

CROSSWIND  LANDING 

CROSSWIND  TAKEOFF 

LANDING  (UNCONTROLLED  FIELD) 

STEEP  TURNS 


LOW  SKILL  LOSS  TASKS 

APPROACH  STALL 

STRAIGHT  AND  LEVEL 

GO-AROUNO 

COMMUNICATIONS 

ENGINE  RUNUP/BEFORE 
TAKEOFF  CHECK 


0  10  20  30  40 

16-MONTH  INCREASE  IN  ERROR  RATE 


FIGURE  4, — FLIGHT  TASKS  EXHIBITING  GREATEST  AND 
LEAST  ABSOLUTE  16 -MONTH  SKILL  LOSS. 


during  this  16-month  interval  was  41.2.)  The  data  that  could  most  meaning¬ 
fully  be  brought  to  bear  on  the  question  of  task  difficulty  and  its  effect  on 
16-month  retention  were  the  maneuver  difficulty  ratings  issued  by  subjects  at 
Che  time  of  their  private  pilot  certification  flight  check.  (Additionally, 
nigh  skill  loss  flight  tasks  produced  appreciably  higher  absolute  error  rates 
on  the  16-month  check  than  low  skill  loss  tasks.  This  does  not,  however, 
indicate  that  the  former  tasks  necessarily  are  more  difficult  than  the 
latter.)  High  skill  loss  tasks  were  rated  by  the  subjects  as  being  more  dif¬ 
ficult  than  low  skill  loss  tasks.  On  a  5-polnt  scale,  the  mean  rating  for 
the  former  group  of  tasks  was  3.3,  while  the  latter  group  received  a  mean 
'ating  of  2.1. 

aKILL  LOSS  ON  FLIGHT  TASKS  AT  24  MONTHS.  For  combined  tasks,  the  mean  (and 
Standard  deviation)  PPOft  error  rate  on  the  24-month  retention  check  was  42.4 
percent  (16.3).  This  produced  an  overall  skill  loss  (as  defined  by  error 
'ate  Incranents)  of  33.5  percent  over  the  24-month  retention  interval. 
Increases  in  error  rates  over  the  24-month  period  were  statistically  signifi¬ 
cant  (p  <  .01)  for  combined  tasks,  as  well  as  for  each  task  considered 
separately  (except  Engine  Runup/Before  Takeoff  Check). 

igure  5  shows  the  tasks  that  demonstrated  the  greatest  and  least  absolute 
imounts  of  skill  loss  over  the  24-month  interval.  The  mean  decranent 
private  pilot  check  to  24-month  check)  for  the  11  tasks  that  underwent  the 
greatest  absolute  amount  of  skill  loss  was  44.5  percent.  The  eight  tasks 
with  the  least  absolute  amount  of  skill  loss  had  a  mean  decranent  of  19.3 
percent. 

COMPOSITE  SKILL  LOSS  ON  FLIGHT  TASKS.  To  determine  the  flight  tasks  that 
demonstrated  the  greatest  overall  decrement  during  the  2-year  retention 
period,  a  composite  ranking  procedure  based  upon  multiple  criteria  was 
generated.  This  was  considered  necessary  since  skill  decrement  on  some  tasks 
manifested  itself  differently  over  the  retention  interval  than  skill  decre¬ 
ment  on  others.  For  instance,  certain  flight  tasks  showed  a  decline  in  per¬ 
formance  after  16  months,  but  remained  relatively  stable  thereafter,  while 
other  tasks  continued  to  decline.  Composite  skill  loss  was  derived  by 
ranking  all  tasks  according  to  each  of  the  following  three  criteria: 
(1)  error  rate  on  the  24-month  check;  (2)  increment  in  error  rate  from  the 
private  pilot  check  to  the  24-month  check;  and  (3)  Increment  In  error  rate 
from  the  private  pilot  check  to  the  16-month  check.  The  three  ranks 
generated  for  each  flight  task  were  then  averaged  to  derive  a  composite  rank. 
Based  on  this  ranking  procedure,  the  flight  tasks  that  exhibited  the  greatest 
and  least  relative  amounts  of  skill  loss  are  shown  in  Table  6.  Lower  ranks 
indicate  greater  skill  loss.  As  can  be  seen  by  comparing  Table  6  data  with 
those  in  Figure  5,  there  is  substantial  commonality  in  the  tasks  included  by 
the  two  procedures  used.  However,  the  rankings  of  tasks  within  groupings 
vary.  Since  the  composite  ranking  procedure  represents  more  aspects  of  per¬ 
formance,  it  may  be  a  more  meaningful  way  of  characterizing  high  and  low 
skill  loss. 

The  composite  rankings  in  Table  6  yield  relative  indices  of  the  magnitude  of 
skill  loss  documented  for  flight  tasks  over  the  2 -year  retention  interval. 
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HIGH  SKILL,  LOSS  TASKS 


LANDING  (UNCONTROLLED  FIELD) 

SHORT  FIELD  LANDING 

S  TURNS  ACROSS  A  ROAD 

RATE  CLIMB  (HOOD) 

MINIMUM  CONTROLLABLE  AIRSPEED 

ACCELERATED  STALL 

TRAFFIC  PATTERN 
(UNCONTROLLED  FIELD) 

TURNS  ABOUT  A  POINT 

MAGNETIC  COMPASS  TURN  (HOOD) 

STEEP  TURNS 

LANDING  (CONTROLLED  FIELD) 

LOW  SKILL  LOSS  TASKS 

STRAIGHT  AND  LEVEL 

COMMUNICATIONS 

APPROACH  STALL 

GO-AROUND 

FORCED  LANDING 

CROSSHIND  TAKEOFF 

ENGINE  FAILURE 

ENGINE  RUNUP/BEFORE 
TAKEOFF  CHECK 


24-MONTH  INCRFJ-.E  IN  ERROR  RATE 


FIGURE  5. — FLIGHT  TASKS  EXHIBITING  GREATEST  AMD 
LEAST  ABSOLUTE  24-MONTH  SKILL  LOSS. 
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Another  measure  of  interest,  however,  concerns  the  rapidity  of  skill  loss  for 
such  tasks.  From  a  continuation  training  viewpoint,  useful  distinctions  can 
be  made  between  flight  tasks  that  exhibit  virtually  all  of  their  decrement 
initially,  and  those  that  ranain  relatively  more  intact  for  greater  periods 
of  time.  Table  7  lists  flight  tasks  that  exhibited  relatively  more  rapid 
decrement.  Thus,  as  compared  with  24-month  performance,  skill  decrement  had 
been  essentially  completed  by  the  3-month  point--i.e.,  the  skill  had  reach 
asymptotic  level  for  those  tasks  shown  in  Table  7.  Flight  tasks  with  skill 
loss  that  had  been  effectively  completed  by  the  16-month  check  were:  'ii.nimum 
Controllable  Airspeed,  Crosswind  Landing,  Normal  Takeoff/Oepartur^ ,  and 
Go-Arounds.  All  regaining  flight  tasks  continued  to  exhibit  decrements 
through  the  24-month  check.  (To  determine  more  precisely  the  function 
depicting  rapidity  of  loss,  multiple  flight  checks  within  each  8-month  reten¬ 
tion  interval  would  have  been  necessary.  For  instance,  monthly  flight  checks 
during  the  initial  8-month  interval  would  have  further  differentiated  among 
Table  7  tasks  with  regard  to  rapidity  of  skill  loss.) 


TABLE  7. --FLIGHT  tasks  with  virtually  completed 
SKILL  LOSS  AT  THE  8-MONTH  RETENTION  CHECK 


Landing  (Uncontrolled  Field) 
unusual  Attitude  Recovery 
Crosswind  Takeoff 
Rate  Climb  (Hood) 

Accelerated  Stall 
S  Turns  Across  a  Road 
Magnetic  Compass  Turn  (Hood) 

Short  Field  Landing 
VOR  Tracking 
Straight  and  Level 
180°  Turn  (Hood) 

Soft  Field  Takeoff 

Turns  About  a  Point 

Engine  Runup/Before  Takeoff  Check 


It  should  be  noted  here  that  the  statement  that  "decrenent  was  essentially 
complete"  by  the  8-month  point  or  the  16-month  point  does  not  Imply  that  skill 
had  reached  the  zero  level.  There  may  have  been  varying  levels  of  residual 
skill  at  the  8-month  or  16-month  points,  but  no  further  decrenent  occurred 
after  that,  i.e.,  the  decrenent,  whatever  It  might  be  for  a  given  task,  was 
completed  by  the  8-month  or  16-month  check. 


WRITTEN  EXAMINATION  DATA. 

As  earlier  noted,  written  examinations  were  administered  to  subjects  just 
prior  to  the  private  pilot  check  and  again  at  the  8-month  retention  check. 


(Subjects  were  asked  not  to  study  written  test  materials  prior  to  their 

8-month  check.  Although  this  variable  could  be  neither  controlled  nor 

measured  accurately,  It  Is  believed  that  subjects  had  minimal  study  time  for 
their  retention  examination.) 

The  respective  means  (and  standard  deviations)  for  written  examinat  'cores 

on  the  private  pilot  check  and  8-month  check  were  91.5  (6.7)  and  £,«.  5). 

Table  8  presents  means  (M)  and  standard  deviations  (SCO  for  written  c.  na¬ 
tion  scores  for  each  group.  Group  C's  scores  were  somewhat  lower  an«  ;ore 
variable  than  scores  for  the  other  two  groups  on  the  8 -month  retention  check. 
Group  A1  s  early  Instrument  training  had  no  effect  on  their  8-month  check 
written  examination  scores  relative  to  Group  B. 


TABLE  8.— WRITTEN  EXAMINATION  SCORES  (PERCENT  CORRECT) 


GROUPS 

PRIVATE  PILOT  CHECK 

8-MONTH 

CHECK 

M  SD 

M 

SO 

A 

93.2  4.8 

82.0 

6.4 

B 

92.0  6.9 

85.8 

7,8 

C 

89.9  6.5 

75.7 

12.6 

i 


Scores  decreased  over  the  8-month  period  for  all  subjects  except  2,  and  the 
magnitude  of  decrement  was  statistically  significant  for  all  three  groups. 
The  correlation  between  written  examination  scores  and  total  PPDR  error  rates 
on  the  8-month  check  was  -.29,  a  relationship  that  Is  not  statistically  signi¬ 
ficant.  The  rather  low  correlation  suggests  that  written  test  scores  are  not 
valid  predictors  of  actual  flight  performance. 

SELF-ASSESSMENT  DATA. 

As  a  group,  subjects  demonstrated  a  moderate  ability  to  predict  and  evaluate 
their  own  overall  proficiency  at  the  8-month  check.  Correlating  subjects' 
prediction  and  evaluation  ratings  with  their  actual  performance  error  rates 
across  all  flight  tasks  resulted  in  rs  of  +.50  and  +.69,  respectively.  These 
correlations  represent  statistically  significant  Improvements  over  counterpart 
ratings  obtained  for  the  private  pilot  cneckrlde.  However,  correlations  of 
subjects'  prediction  and  evaluation  ratings  with  their  actual  performance  on 
individual  flight  tasks  resulted  in  rs  ranging  from  -.10  to  +.69,  with  a  mean 
~r  (via  Fisher  z_  transformations)  of  +.36,  Thus,  subjects  demonstrated  a 
moderate  ability  to  predict  and  evaluate  their  own  overall  performance,  but 
were  not  very  accurate  In  the  case  of  specific  flight  tasks. 
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DISCUSSION 


In  order  to  provide  a  framework  for  Integrating  the  somewhat  diverse  results 
of  this  study,  they  will  be  discussed  with  reference  to  the  earl ier- stated 
primary  research  objectives.  The  first  objective  dealt  with  the  retention 
patterns  for  private  pilot  flight  skills.  The  second  concerned  experience  and 
other  factors  that  influence  the  skill  retention  pattern.  The  third  related 
to  continuation  training  designed  to  forestall  skill  loss.  A  secondary  objec¬ 
tive  was  to  determine  the  extent  to  which  pilots  are  capable  of  predicting  and 
evaluating  their  own  levels  of  proficiency.  Due  to  the  substantial  implica¬ 
tions  of  the  present  findings  for  general  aviation  operations,  the  third 
objective  area  (continuation  training)  warrants  special  consideration  and, 
therefore,  will  be  treated  separately  in  the  following  section.  Tne  ether 
three  objectives  are  addressed  sequentially  in  the  following  discussion. 

As  was  stated  earlier  in  this  report,  while  there  has  been  a  long-standing 
general  concern,  with  the  question  of  flight  skill  retention,  there  has  been 
relatively  little  enpirical  data  describing  the  retention- forgetting  function 
for  such  skills.  This  is  particularly  the  case  with  reference  to  general 
aviation  pilots.  Because  of  various  events  and  factors  that  are  influencing 
the  manner  and  extent  to  which  general  aviation  pilots  are  able  to  maintain 
skili  currency  and  proficiency,  the  problem  of  skill  decay  over  time  is  of 
increasing  concern.  Further,  the  existing  system  of  recurrent  checks  on  pilot 
skills  (the  BFR)  necessar^y  requires  that  the  individual  pilot  take  primary 
responsibility  for  assessing  his  own  continuation  training  needs  and  providing 
for  them.  For  these  reasons,  the  patterns  of  pilot  skill  retention  and  the 
magnitude  of  skill  loss  over  time  are  matters  of  broau  concern  to  general 
aviation  safety. 

SKILL  RETENTION  PATTERNS . 

Skill  loss  was  substantial  (PPDR  error  rates  increased  an  average  of  33.4  per¬ 
cent  on  the  24-month""c7ieck  relative  to  the  private  pilot  check),  rapid  (the 
majority  of  skill  loss  was  documented  at  the  8-month  check  except  as  miTigated 
by  interpolated  training),  and  pervasiv.  (virtually  every  subject  and  every 
task  exhibited  statistically  significant  loss) .  These  findings  are  clearly  of 
operational  significance  and  indicate  that  if  skills  acoulred  during  initial 
training  are  not  practiced  regularly,  they  will  undergo  substantial  decrement. 
The  overall  pattern  of  skill  loss  documented  in  this  study  was  one  charac¬ 
terized  by  relatively  great  proficiency  loss  during  the  Initial  8  months, 
followed  by  continued,  but  diminishing,  loss  thereafter. 

Flight  tasks  requiring  a  relatively  high  degree  of  integration  among  cogni¬ 
tive,  procedural,  and  control  components  exhibited  appreciable  loss.  Among 
these  tasks  were  operations  into  and  out  of  airports  (especially  under  adverse 
conditions)  and  certain  basic  Instrument  maneuvers  performed  under  the  hood. 
In  addition,  ground  reference  maneuvers,  steep  turns,  and  accelerated  stalls 
showed  relatively  high  amounts  of  skill  decrement.  These  latter  maneuvers, 
while  not  typically  practiced  with  any  degree  of  frequency  by  private  pilots, 
are  included  in  the  private  pilot  curriculum  because  their  execution  involves 
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practice  and  reinforcement  of  general  skills  that  are  used  in  a  wide  variety 
of  operational  flight  tasks.  One  of  tnese  general  skills  is  the  ability  of 
the  pilot  to  control  the  aircraft  in  precisely  the  desired  manner  (1„e.,  to 
make  the  aircraft  do  what  one  wants  it  to  do).  Another  is  to  exercise 
planning  and  judgment  such  that  unexpected  or  stressful  event*-  are  minimized 
(i.e.,  staying  ''ahead  of  the  aircraft").  From  a  continuation  training 
standpoint,  the  interest  should  be  in  how  these  skills  can  best  be  maintained 
(or  upgraded),  and  in  how  they  should  be  practiced  and  assessed.  The  final 
section  of  this  report  discusses  these  and  other  factors  relating  to 
continuation  training  for  private  pilots. 

To  summarize  the  findings  relative  to  the  pattern  of  flight  skill  retention, 
then,  it  is  clear  that  skill  loss  is  a  general  phenomenon  that  will  affect 
substantially  all  general  aviation  pilots  in  significant  fashion  if  skills  are 
not  practiced.  Thus,  the  skill  retention  "problem"  among  general  aviation 
pilots  is  confirmed  to  be  a  substantial  one,  and  serious  thought  should  be 
given  by  the  FAA  to  means  of  managing  or  alleviating  this  problan. 

EXPERIENCE  FACTORS  AFFECTING  SKILL  RETENTION. 

The  occurrence  of  interpolated  instrument  training  was  the  only 
experience/background  factor  that  appeared  to  have  consistently  benefited 
skill  retention  patterns.  The  pattern  of  loss  varied  with  the  time  at  which 
the  interpolated  training  occurred,  but  overall  skill  loss  assessed  at  24 
months  was  substantial  and  definitely  would  be  of  concern  from  the  standpoint 
of  operational  safety,  regardless  of  whether  subjects  had  undergone  training 
since  certification.  The  effect  of  such  training  was  to  delay  skill  decrement 
but  not  to  prevent  it,  since  beneficial  Interpolated  training  effects  were 
documented  for  one  group  of  subjects  (Group  A)  ori  the  8-month  retention  check 
and  for  another  (Group  B)  on  the  16-month  check.  Subjects  had  virtually  no 
recent  flying  experience  (in  connection  with  training  or  otherwise)  at  the 
time  of  the  24-month  check,  and  their  performance  decrement  appears  to  have 
been  substantially  complete  by  that  time. 

No  appreciable  relationships  were  found  between  subjects'  scores  on  written 
examinations  (or  other  background  data)  and  their  actual  flight  performance. 
Written  examinations,  as  presently  administered  by  the  FAA,  are  not  perfor¬ 
mance  oriented.  That  is,  they  are  riot  designed  to  assess  the  pilot's 
understanding  of  the  requirements  for  executing  specific  flight  tasks  and 
missions.  Rather,  the  examinations  tend  to  tap  the  pilot's  theoretical 
knowledge  of  general  content  areas.  Thus,  this  lack  of  relationship  to  flying 
perfonnance  is  not  surprising. 

While  none  of  the  background  and  experience  variables  (other  than  interpolated 
training)  was  found  to  relate  to  flight  performance  and  retention,  some 
caution  should  be  exercised  in  generalizing  this  finding  to  the  broader 
general  aviation  pilot  population.  It  should  be  kept  in  mind  that  the  sample 
of  subjects  in  this  study  was  not  selected  randomly  from  among  the  general 
aviation  population.  Further,  the  subjects  were  relatively  homogeneous  with 
respect  to  most  flight  experience  variables.  Thus,  it  is  possible  that  some 
of  the  experience  factors  examined  might  show  a  different  relationship  to 
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flight  performance  and  skill  retention  among  a  broader  sampling  of  general 
aviation  pilots.  Nevertheless,  the  fact  that  no  significant  relationships 
were  found,  except  for  interpolated  training,  suggests  that  use  of  any  such 
indirect  indices  of  pilot  skill  (e.g.,  total  hours,  written  test  scores,  etc.) 
to  assess  retention  is  questionable  at  best,  and  may  be  totally  misleading  at 
worst. 

PILOTS1  SELF-ASSESSMENTS. 

Pilots  demonstrated  a  moderate  ability  to  predict  and  assess  their  own  overall 
performance.  This  finding  is  somewhat  encouraging  for  continuation  training 
applications,  in  that  those  who  would  be  willing  to  undergo  such  training  to 
refresh  or  upgrade  certain  flight  skills  must  first  recognize  that  a  problem 
exists.  The  prediction  and  evaluation  ratings  indicated  some  such  degree  of 
skill  decrement  recognition  by  subjects.  However,  for  specific  flight  tasks, 
their  prediction  and  evaluation  ratings  failed  to  show  any  relationship  to 
actual  PPDR  errors.  The  lack  of  such  a  relationship  is  of  ultimate  concern 
from  the  standpoint  of  operational  safety,  since  it  suggests  that  the  indi¬ 
vidual  pilot  is  not  able  to  diagnose  specifically  his  own  continuation 
training  needs. 

As  noted,  the  viability  of  the  present  system  of  identifying  and  providing  for 
continuation  training  needs  rests,  in  considerable  degree,  upon  the  ability  of 
the  Individual  to  make  such  sel f-assessments  and  to  institute  appropriate 
ranedial  action.  Of  course,  there  are  other  mechanics  that  exert  an 
influence  in  this  area  (e.g.,  the  enforcement  of  minimum  skill  standards  as  a 
condition  to  aircraft  rental),  but  for  a  substantial  portion  of  the  general 
aviation  pilot  population,  the  decisions  as  to  the  need  for  and  nature  of 
continuation  training  are  still  largely  made  by  the  individual  pilot. 

Again,  whether  these  findings  concerning  accuracy  of  self-assessments  can  be 
generalized  to  the  broader  population  of  general  aviation  pilots  can  be 
questioned.  For  example,  it  is  reasonable  to  hypothesize  (but  by  no  means  to 
conclude)  that  more  experienced  pilots  are  better  able  to  assess  their  own 
skills  and  training  needs.  However,  the  fact  remains  that  these  data  strongly 
suggest  that  there  are  still  substantial  numbers  of  general  aviation  pilots 
whose  capability  to  assess  their  own  skills  is  suspect. 

The  following  section  contains  information  concerning  the  effective  use  of 
continuation  training  for  addressing  proficiency  loss  among  private  pilots. 
Included  In  this  brief  discussion  are  problems  in  defining  the  extent  to  which 
different  types  of  skills  degrade;  the  cognitive/procedural  errors  that  were 
observed  in  the  present  study;  general  aviation  continuation  training  as  It 
presently  exists;  and  some  thoughts  concerning  ways  in  which  continuation 
training  could  be  made  more  effective,  especially  as  It  pertains  to  cognitive 
skill  loss. 
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IMPLICATIONS  TOR  CONTINUATION  TRAINING 


THE  GENERAL  PROBLEM  OF  SKILL  DEGRADATION. 

Results  of  the  present  study  strongly  indicate  that  private  pilots  who  do  not 
operate  frequently  need  continuation  training  to  maintain  or  upgrade  flight 
skills.  These  findings  support  and  extend  those  of  previous  investigations  of 
flight  skill  retention  anong  general  aviation  pilots  (references  22  and  23). 
Flight  skills  in  general  decline  rather  rapidly  and  extensively  after  cessa¬ 
tion  of  flying.  Further,  skills  for  some  tasks  decline  to  a  greater  degree 
than  skills  for  others.  From  a  continuation  training  standpoint,  it  is  impor¬ 
tant  to  identify  the  types  of  flight  skills  that  extensively  and/or  quickly 
degrade  since  the  type  and  content  of  training  should  be  tailored  to  hose 
skills. 

In  the  present  study,  the  flight  tasks  that  exhibited  relatively  large  amounts 
of  skill  loss  over  the  2-year  retention  period  all  are  operationally  critical. 
Their  Importance  stems  from  the  fact  that  some  (e.g.,  landings  on  short  run¬ 
ways  or  at  uncontrolled  fields)  are  of  direct  use  in  operational  settings, 
while  others  (e.g.,  ground  reference  maneuvers)  are  more  abstract  and  involve 
basic  skills  that  underly  the  execution  of  the  former  tasks.  Some  (e.g.,  VQR 
tracking)  are  critical  not  only  because  they  are  required  for  safe  flight 
operations,  but  also  because  skills  on  them  degraded  relatively  quickly. 
Continuation  training  methods  should  be  generated  with  this  in  mind,  but  to  be 
most  effective  and  efficient,  the  methods  need  to  address,  to  the  extent 
possible,  the  specific  skills  involved  in  perfunning  these  tasks. 

IDENTIFICATION  OF  THE  NATURE  OF  DEGRADED  SKILLS. 

Studies  of  pilot  flight  skill  retention  have  reported  that  skills  involving 
substantial  cognitive/procedural  components  undergo  relatively  greater  and 
more  rapid  decranent  over  time  than  control-oriented  skills  (references  5  and 
33  through  36).  To  attempt  to  identify  the  types  of  skills  that  degraded  in 
the  present  study,  an  exploratory  post  hoc  analysis  was  conducted  of  those 
PPDR  items  on  which  errors  were  made. 

For  the  most  part,  the  PPIJR,  like  other  flight  measurement  instruments,  is  not 
designed  to  differentiate  precisely  among  skills  involved  In  the  successful 
execution  of  flight  tasks.  Most  of  the  measures  contained  in  the  instrument 
are  primarily  aircraft  control-oriented,  although  it  is  obvious  that  cogni¬ 
tive,  decisional,  and  procedural  components  contribute  to  maintaining  the 
aircraft  in  the  desired  control  conditions,  and  such  components  may  or  may  not 
be  measured  and  reflected  in  the  error  rate  for  a  flight  task.  An  example 
will  clarify  this  point.  A  pilot  may  err  in  achieving  the  proper  level  off 
altitude  In  a  takeoff  and  departure.  The  error  is  then  recorded  for  the  alti¬ 
tude  measure  within  the  level  off  segment  of  the  PPDR,  but  the  checkpilot  Is 
not  certain,  for  example,  whether  the  pilot  (1)  remembered  the  desired  alti¬ 
tude,  but  failed  to  achieve  it  (control  error);  (2)  forgot  the  desired  alti¬ 
tude  (cognitive  error);  or  (3)  forgot  to  stop  the  climb  at  the  proper  point 
(cognitive/procedural  error).  Regarding  the  third,  and  apparently  most 


33 


common,  difficulty,  what  Is  often  missing  in  a  skill  is  a  clear,  more  or  less 
automatic,  guiding  of  motor  actions  because  of  degradation  of  cognitive 
monitoring  as  the  action  evolves.  (As  used  here,  "monitoring"  refers  to  miicTt 
more  than  the  term  typically  includes  in  flight  contexts.  All  skills,  motor 
actions  included,  are  guided  by  cognitive/perceptual  processes  that  relate  the 
moment- to-moment  status  of  an  ongoing  action  to  an  awareness  of  what  should  be 
happening  at  any  given  time.  Successful  monitoring  requires  sensitivity  to 
any  feedback  or  effects  of  an  action  that  indicate  correct  performance  or  a 
need  for  an  adjustment  during  an  action.  While  information  from  instrument 
scans  and  out- the- wi ndow  scenes  is  important  for  monitoring,  it  is  also 
necessary  to  have  a  proper  sense  of  timing  of  actions  which  requires  a  clear 
cognitive  pattern  of  how  components  of  an  action  relate  to  each  other.)  The 
pilot  may  know  what  is  to  be  done,  but  not  when  in  the  sense  of  maintaining 
coordinated  action. 


Despite  these  diagnostic  complexities,  it.  is  possible  to  identify  PPDR 
measures  that  are  predominantly  cognitive/procedural  in  nature.  Examples  of 
such  measures  are  using  proper  entry  procedures  for  stalls,  using  proper  flap 
settings  for  go-arounds  or  soft  field  takeoffs,  and  acknowledging  and 
complying  with  all  ATC  instructions. 


The  exploratory  analysis  revealed  that  measures  such  as  the  above  frequently 
were  performed  in  error  ori  the  24-month  retention  check.  For  instance,  all 

acknowledge  at  least  one  ATC  instruction  at  some  point 
check,  and  7G  percent  of  the  subjects  used  improper 


subjects  failed  to 
luring  "thi  s  f!  ight 
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procedures  for  one  or  more  of  the  stall  maneuvers.  Examples  of  other  pri¬ 
marily  cognitive  errors  are  shown  in  Table  9.  Thus,  while  clear  distinctions 
cannot  be  drawn  between  cognitive/ procedural  errors  and  control  errors  on  the 
basis  of  measures  contained  in  the  PPDR,  it  is  possible  that  much  (and  pro¬ 
bably  most)  of  the  skill  loss  documented  in  the  present  study  is  attributable 
to  forgetting  of  task  performance  requirenents  as  they  evolve  stage  by  stage 
during  the  task. 


CONTINUATION  TRAINING  NEEDS, 


flying  is  a  psychomotor  process.  That  is,  pilots  must  attend  to  relevant 
cues,  recognize  such  cues  when  they  occur,  decide  upon  appropriate  responses 
to  those  cues,  and  respond  accordingly.  The  response  (or  motor)  aspects  of 
the  process  are  generally  well  learned  during  initial  training,  and  although 
they  may  deteriorate  somewhat  over  time,  brief  intermittent  practice  in  the 
aircraft  (monitored  by  a  checkpilot)  or  on  a  training  device  of  appropriate 
control  fidelity  usually  is  sufficient  to  regain  them.  The  greater  concern  is 
with  the  perceptual/cognitive  (or  mental)  processes  related  to  cue  maintenance 
required  for  successful  monitoring  of  actions.  It  is  effective  monitoring 
processes  that  appear  to  be  significant  factors  in  the  preponderance  of 
general  aviation  accidents  that  are  attributed  to  "pilot  error"  (reference 
12). 


Cues  are  formed  when  pilots  attach  meaning  or  significance  to  perceptible 
Internal  or  external  objects  or  events  (references  37  and  38).  For  example, 
on  the  downwind  leg  of  a  traffic  pattern,  a  point  that  is  approximately 


TABLE!  9 .--EXAMPLES  OF  PREDOMINANTLY  COGN1TIVE/PROCEOURAL  ERRORS 
ON  THE  24-MONTH  RETENTION  CHECK 


_ ERRORS _ 

Cross-Country  Planning 

•  Inc orrect "TstTma t  i o n  of  time  enroute 
«  Inability  to  verbalize  communications 

requirements  for  change  in  fl  ight  plan 

•  Incorrect  ETA  calculation 

•  Incorrect  fuel  requirement  estimation 

VOR  Tracki ng 

«  FaTTure  to  identify  station 

•  Failure  to  identify  radial 

Stall s 

i  Failure  to  perform  correct  entry  procedures 

•  Failure  to  achieve/recognize  stall 

Forced  Landing 

e  Poor  selection  of  landing  area 

•  Inability  to  verbalize  correct  procedures 

Engine  Failure 

t  Failure  to  turn  on  carb  heat 

Uncontrolled  Field  Traffic  Pattern 

•  Incorrect  entry  Taltltude  or distance  out) 

•  Failure  to  perform  cockpit  check 
t  Improper  flaps  or  trim 

Soft  Field  Takeoff 

•  Failure  to  use  rolling  start 

•  Improper  flaps  or  trim 

Turns  About  a  Point 

•  Improper  entry/exit 

Communi cations 

"•  Failure  to  understand/comply  with  ATC  messages 

•  Failure  to  tune  correct  frequency 

•  Improper  use  of  microphone 


tetscehtage  arm wm — ~ 

COMMITTING  ERRORS 


Taxiing 

•  Improper  control  positioning 

•  Improper  brake/power  usage 
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opposite  the  landing  end  of  the  runway  (the  180°  point)  normally  should  serve 
as  a  visual  cue  for  reducing  power.  Since  the  prelar.dirig  checklist  should  be 
perfonnecT  prior  to  reaching  the  180°  point,  performing  the  checklist  could, 
through  experience,  serve  as  a  mental  cue  for  reninding  (conditioning)  the 
pilot  to  watch  for  the  180°  pelTvtT.  Once  they  are  remenbered,  the  actual 
responses  performed  by  the  pilot  in  this  example  are  relatively  simple, 
straightforward,  and  easily  retained  over  prolonged  periods  of  time.  However, 
as  the  data  in  Table  9  imply,  the  cjes  for  making  those  responses  are  not  so 
well  retained.  Thus,  one  of  the  challenges  in  developing  and  implementing 
effective  continuation  training  is  to  provide  general  aviation  pilots  with 
techniques  and  procedures  that  will  enable  them  to  practice  and  reinforce  the 
mental  cues  necessary  for  monitoring  actions.  The  capability  to  recognize  and 
to  respond  cc  such  cues  is  the  basis  for  flight  skill  development,  and  it  Is 
crucial  for  skill  retention. 


both  the  general  literature  on  skill  retention  and  the  results  of  the  present 
study  suggest  that  generation  of  methods  to  improve  the  retention  of  cognitive 
skills  should  be  one  of  the  primary  objectives  of  continuation  training. 
Retention  is  enhanced  to  the  extent  cueing  structures  can  be  maintained. 
Tnus,  continuation  training  should  focus  on  the  cues  that  are  necessary  for 
sustaining  pertinent  skills.  Ideally,  cues  and  their  relevance  for  safe 
operations  would  be  systematically  stressed  or  anphasized  during  initial 
training.  This  would  better  enable  pilots  to  attenuate  irrelevant  cues  while 


attaching  significance  to  certain  relevant  cues  and  associating  them  with 


correct  responses.  Unfortunately,  cue  development  is  not  typically  emphasized 
in  private  pilot  training.  Instead,  cues  more  often  are  learned  unsystem¬ 
atically  through  experience.  The  goals  of  continuation  training  shoulo  be  to 
identify  relevant  cues,  teach  those  cues  if  they  have  not  already  been 
obtained,  reinforce  those  cues  if  they  have  been  obtained,  and  associate  them 
with  the  proper  responses. 


Given  that  pilots  experience  significant  performance  decrements  over  rela¬ 
tively  short  time  periods,  and  that  such  decrements  a^e  at  least  partly  cogni¬ 
tive  in  nature,  methods  should  be  sought  to  reduce  or  alleviate  this  type  of 
skill  loss.  As  has  been  noted  elsewhere,  the  process  of  defining  and  imple¬ 
menting  optimal  training  methods  is  not  straightforward  oecause  of  the  many 
complexities  involved  (references  6,  7,  and  21).  Some  of  these  complexities 
have  been  touched  on  in  this  report,  but  there  are  many  more  related  to 
characteristics  of  the  pilot  (e.g.,  skills,  motivation,  physical  condition, 
experience,  recency  of  flight),  the  task  (e.g.,  performance  requirements, 
practice  frequency) ,  the  aircraft  (e.g.,  equipment,  handling  characteristics), 
the  environment  (e.g.,  weather,  airport,  traffic),  and  other  factors.  In 
spite  of  this,  the  most  promising  approach  to  maintaining  the  skills  necessary 
for  safe  and  efficient  flight  operations  is  through  the  systematic  and 
intelligent,  use  of  continuation  training  techniques. 

A  very  effective  technique,  and  one  easily  employed,  is  mental  rehearsal  of 
what  one  does,  step  by  step,  in  performing  a  task.  Henta1  rehearsal  has  been 
shown  to  be  highly  effective  not  only  in  the  retention  of  motor  skills,  but  In 
their  acquisition.  (See  reference  39  for  a  ev*ew  of  laboratory  and  applied 
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research  on  this  topic.)  Effectiveness  requires  only  sufficient  prior 
experience  in  the  task  to  make  cues  and  actions  comprising  each  step  meaning¬ 
ful  and  imaginable.  (A  cockpit  mock-up  would  aid  in  the  rehearsal.)  One 
likely  problen  with  skill  retention  by  the  subjects  in  the  experiment  reported 
here  was  that  generally  they  were  not  personally  dedicated  to  flying,  which 
was  evidenced  by  their  failure  to  fly  except  during  formal  training.  Hence, 
it  is  unlikely  that  they  rehearsed  the  flight  tasks  mentally  and  seriously 
once  training  had  ended.  If  they  had,  retention  probably  would  have  been 
better. 

The  present  mechanism  in  general  aviation  for  proficiency  maintenance  is  the 
Biennial  Flight  Review.  Part  61.57  of  the  Federal  Aviation  Regulations 
requires  all  pilots  to  undergo  a  BFR  every  24  months.  While  there  are  several 
programs  designed  to  encourage  pilots  to  maintain  or  upgrade  their  knowledge 
and  skills,  the  BFR  is  the  only  requirement  to  do  so.  However,  as  earlier 
mentioned,  several  studies  have  indicated  that  the  BFR  does  not  accomplish  its 
intended  purpose  because  of  deficiencies  in  its  content  and  administration 
(references  12,  24,  arid  25).  Among  these  deficiencies  are  a  lack  of: 

1.  guidance  concerning  the  specific  skills  to  be  assessed; 

2.  objective  assessment  criteria; 

2.  uniformity  among  instructors  in  the  administration  of  the  BFR;  and 

4.  documentation  of  unsati sfactory  BFR  outcome. 

Additionally,  the  BFR  does  not  sufficiently  adHress  the  cognitive/ procedural 
types  of  skills  that  are  rather  rapidly  lost  during  lapses  in  operations. 
Data  from  the  present  study  indicate  that  2-year  reviews  are  not  sufficiently 
frequent  to  upgrade  flight  skills  lost  by  relatively  inexperienced  private 
pilots.  The  same  is  probably  true  for  more  experienced  pilots  who  do  not 
operate  over  prolonged  time  periods.  In  view  of  the  above  problems,  effective 
and  efficient  continuation  training  programs  are  needed  to  maintain  and 
upgrade  safety  among  general  aviation  pilots.  Following  is  a  brief  discussion 
of  continuation  training  media  that  are  potentially  useful  in  the  facilitation 
of  cognitive  skills  and  cue  retention. 

TRAINING  MEDIA. 

In  a  generic  sense,  cognitive  training  is  a  term  used  to  refer  to  the  specifi¬ 
cation  and  teaching  of  the  knowledge  aspects  of  a  complex  task  (i.e.,  o;.e 
involving  complex  interactions  among  perceptual,  cognl tive/deci sional ,  and 
motor  components) .  Various  types  of  training  media  can  be  effectively 
employed  in  conjunction  with  cognitive  training.  These  Include,  but  are  not 
limited  to,  the  types  of  media  to  be  discussed. 

There  is  empirical  support  for  the  effective  use  of  cognitive  training  for 
imparting  flight  skills  (references  38,  40,  41,  and  42).  Its  facilitative 
effects  largely  are  derived  from  its  role  in  the  cue  development  process, 
because  it  is  adaptive  to  the  task,  the  aircraft,  and  pilots'  diverse  learning 
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styles,  and  because  extensive  use  is  made  of  feedback  and  guidance.  Cognitive 
training  also  promotes  the  development  of  medlational  processes  Including 
internal  verbalization  of  task  performance  requlranents,  specific  techniques 
for  memorizing  such  requlranents  (termed  mnemonics),  and  mental  Imagery  and 
rehearsal . 

The  effective  use  of  cognitive  training  calls  for  the  task  performance 
requirements  to  be  carefully  analyzed  before  implementation  occurs.  In 
addition,  objectives  of  the  training  should  be  explicitly  stated  and  kept 
clearly  in  mind  by  trainees. 

In  view  of  the  pervasive  role  of  cognitive  processes  in  skill  development  and 
retention,  the  major  advantages  of  cognitive  continuation  training  are  Its 
relatively  low  cost  when  used  with  such  media  as  slides  (or  other  visual  aids) 
and  audio  tapes  (or  written  text);  its  versatility,  flexibility,  and  ease  of 
use  as  compared  to  fixed-base  simulators  or  even  table  top  trainers;  its 
potential  for  upgrading  skills  generally;  and  perhaps  most  important,  the  fact 
that  it  can  be  self- administered  by  pilots,  assuming  that  they  know  what  their 
skill  deficiencies  are.  Current  disadvantages  of  cognitive  training  are  its 
apparent  inability  to  improve  substantially  degraded  motor  skills  and  the 
neutral  or  negative  attitudes  of  the  general  aviation  community  concerning  its 
potential  training  benefits. 

Several  types  of  training  media  are  of  potential  benefit  to  general  aviation 
pilots  seeking  to  improve  or  maintain  cognitive  skills  acquired  as  a  result  of 
their  earlier  training.  Of  these,  the  most  complex  are  likely  the  high  fidel¬ 
ity  simulators  anployed  by  commercial  aviation  training  centers.  Examples  of 
such  devices  are  the  simulators  used  in  training  pilots  to  operate  (or  tran¬ 
sition  to)  business  jets.  Other  types  of  devices  are  the  GATs  (1  and  2)  that 
are  used  in  training  for  a  broad  range  of  less  complex  aircraft.  For 
increased  portability,  smaller,  less  sophisticated  devices,  such  as  "table 
top"  trainers,  can  be  used  for  training  in  aircraft  of  the  same  class.  The 
training  value  of  such  media  can  be  considerable  when  they  are  used  optimally. 

An  additional  type  of  training  medium  is  the  computer- generated  image  (CGI) 
video  display.  Such  displays  include  dynamic,  rapid  rate- of- change  represen¬ 
tations  of  internal  and  external  visual  scenes  as  they  are  viewed  by  the  pilot 
during  various  phases  of  flight.  For  example,  during  an  approach  to  landing, 
the  pilot  might  see  external  scenes  such  as  horizon  and  runway,  and  Internal 
scenes  might  include  instrument  indications  of  airspeed,  altitude,  engine  RPM, 
descent  rate,  and  heading.  Pilots  can  practice  monitoring  their  performance 
by  interacting  with  the  visual  scenes  via  keyboards,  joysticks,  and  other 
input  devices.  Research  using  CGI  has  shown  that  significant  training 
enhancements  can  accrue  due  to  the  capability  to  introduce,  emphasize,  and 
otherwise  modify  visual  cues  for  guiding  the  pilot  through  the  proper  execu¬ 
tion  of  the  task  (references  43  and  44).  As  they  decrease  in  cost,  CGI 
devices  offer  much  promise  for  private  pilot  continuation  training. 

More  recently,  software  packages  for  microcomputers  have  become  commercially 
available.  Unlike  the  somewhat  more  sophisticated  CGI  presentations  used  in 
controlled  research  contexts,  these  software  packages  have  not  been 
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specifically  designed  to  include  effective  training  cues.  They  are  intended 
primarily  to  serve  as  games,  and,  as  such,  do  not  presently  appear  to  be 
viable  continuation  training  media.  If  designed  with  continuation  training  in 
mind,  however,  or  if  used  in  a  manner  that  exploited  whatever  effective  cues 
presently  are  contained  in  these  packages,  they  could  serve  to  upgrade  certain 
types  of  private  pilot  flight  skills.  Results  of  the  present  study  suggest 
that  new  or  modified  designs  of  microcomputer  software  packages  for  con¬ 
tinuation  training  purposes  should  concentrate  on  providing  cues  for  assisting 
pilots  in  ranembering  the  performance  requirements  for  the  flight  tasks  that 
are  necessary  for  safely  conducting  a  mission.  Systematic  research  is  needed 
to  more  fully  address  this  question,  but  it  appears  that  the  forgetting  of 
task  perfonnanc  .  .;ui rements  is  a  major  problem  in  private  pilot  flight  skill 
retention. 


A  training  medium  that  appears  to  be  largely  underused  by  general  aviation 
pilots,  but  one  which  can  be  effective  if  used  seriously  and  intelligently, 
consists  of  photographs,  slides,  and  mock-ups  of  aircraft  cockpit  instrumen¬ 
tation  and  external  scenes.  Most  pilots  have  consulted  aircraft  cockpit 
diagrams  contained  in  operating  manuals  as  part  of  their  ground  school  or  in 
mentally  rehearsing  a  procedure.  Research  on  the  use  of  these  static  media 
has  indicated  that,  when  used  as  part  of  a  structured  training  program,  they 
can  be  very  effective  and  efficient  (references  42,  45,  and  46).  However,  few 
programs  currently  integrate  such  media  into  their  training  curricula. 
Training  materials  such  as  those  produced  by  Kers liner  (reference  29)  and 
others  include  a  good  selection  of  illustrations  of  both  internal  and  external 
scenes,  but  the  training  benefits  of  such  material  are  not  being  fully 
realized.  As  earlier  noted,  one  of  the  factors  underlying  this  shortcoming 
concerns  the  strongly  conditioned  traditional  attitudes  among  the  general 
aviation  training  community  (which,  of  course,  influence  the  attitudes  of  the 
pilots  themselves)  that  anphasize  the  importance  of  airborne  training  and 
(intentionally  or  unintentional ly)  ignore  the  training  potential  of  static, 
ground-based  media.  While  some  of  the  more  innovative  flight  instructors 
employ  these  latter  methods  to  reinforce  in-flight  training  material,  few  ini¬ 
tial  training  packages  offered  commercial ly  include  these  methods  in  their 
regularly  scheduled  training.  Further,  there  are  no  known  instances  of  the 
structured  use  of  such  methods  for  effective  continuation  training.  The  use 
of  static  ground-based  media  for  private  pilot  continuation  training  needs 
empirical  investigation. 


Finally,  a  promising  approach  to  effective  continuation  training  consists  of 
the  use  of  full  mission  simulation  for  evaluating  pilots'  decisions  and 
responses  to  critical  in-flight  events.  The  approach  uses  relatively  ccmprey 
hensive  flight  scenarios  (rather  than  discrete  flight  tasks)  to  assess  pilots' 
reactions  to  such  events.  Although  full  mission  simulation  has  most  commonly 
been  used  with  relatively  sophisticated  training  devices  (reference  47),  a 
recent  study  (reference  48)  demonstrated  positive  results  using  a  GAT-1  to 
assess  cogni tive/deci slon-making  skills.  The  use  of  a  pa per- and- pencil  device 
based  on  the  above  methodology  also  yielded  encouraging  results.  It  was 
concluded  in  the  Rockwell  and  Giffen  study  (reference  48)  that,  when  coupled 
with  instruments  that  can  provide  valid  assessments  of  pilots'  operational 
knowledge,  full  mission  simulation  can  be  a  valuable  continuation  training 
tool . 
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TAILORING  TRAINING  MEOIA  TO  DEGRADED  SKILLS. 


Media  to  be  used  for  continuation  training  purposes  should  be  selected  on  the 
basis  of  the  flight  skills  to  be  maintained  or  upgraded.  It  would  make  little 
sense,  for  example,  to  enploy  computer- generated  image  displays  for  upgrading 
complex  control  skills  when  devices  with  higher  control  fidelity  are  needed. 
On  the  other  hand,  CGI  displays  can  be  very  effective  for  rehearsing  the 
visual  discrimi nations  that  are  necessary  for  associating  external  with  inter¬ 
nal  cues.  The  present  data  suggest  that  such  discriminations  undergo  appre¬ 
ciable  decrenent  when  not  practiced  regularly.  Similarly,  it  would  be 
unnecessarily  costly  to  enploy  a  complex  motion-based  simulator  solely  for  the 
purpose  of  upgrading  simple  cockpit  procedures  when  much  simpler  devices  would 
suffice. 

The  flight  tasks  exhibiting  the  greatest  amount  of  composite  skill  loss  (Table 
6}  in  this  study  cannot  clearly  be  categorized  by  the  type  of  component  skills 
predominantly  involved  in  their  successful  execution.  Rather,  several  types 
of  skills  are  required  to  perform  these  tasks.  It  has  already  been  shown, 
however,  that  at  least  part  of  the  flight  skill  loss  documented  in  this  study 
can  be  attributed  to  cogni tive/procedural  errors  by  the  subjects.  The  use  of 
relatively  simple  training  media,  accompanied  by  mental  rehearsal,  may  be  suf¬ 
ficient  for  upgrading  cognitive/procedural  skills.  Given  that  their  cognitive 
skills  are  acceptable,  pilots  may  need  to  sharpen  thei.  control  skills  via  the 
use  of  somewhat  more  sophisticated  devices.  Pilots  should,  perhaps,  be  more 
aware  than  anyone  of  the  need  to  increase  their  precision  in  controlling  the 
aircraft.  If  continuation  training  is  warranted,  a  device  with  appropriate 
control  fidelity  should  be  enployed.  If  only  gross  control  responses  to  cues 
arising  in  the  cockpit  need  upgrading,  a  few  hours  in  a  GAT  or  even  a  table 
top  trainer  may  be  all  that  is  required.  If  more  precise  and  subtle  control 
movements  need  to  be  sharpened,  a  high-fidelity  simulator  may  be  the  only 
acceptable  substitute  for  in-flight  time.  Decisions  about  the  type  of 
training  medium  to  be  enployed  should  be  made  at  least  partially  on  the  basis 
of  the  nature  of  the  skills  that  are  to  be  practiced.  On  the  basis  of  the 
present  findings,  it  would  appear  that  relatively  simple  static  training  media 
used  as  part  of  an  effective  cognitive  training  regimen  could  quite  effec¬ 
tively  serve  to  forestall  loss  of  many  flight  skills  for  private  pilots. 
Should  empirical  research  demonstrate  the  viability  of  such  media  for  con¬ 
tinuation  training,  it  could  be  an  economical  way  to  reduce  general  aviation 
accidents  involving  private  pilots. 

Many  criteria  exist  for  evaluating  the  usability  of  cognitive  (and  other) 
training  for  maintaining  ur  upgrading  private  pilot  flight  skills.  These 
include  (but  are  not  limited  to); 

1.  the  cost  of  training  (acquisition,  conduct,  and  maintenance); 

2.  amount  of  training  required  to  maintain/upgrade  skill; 

3.  flexibility  of  the  training  for  addressing  various  types  of  skills; 

4.  portability  of  the  training  media; 
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5. 


ease  of  use; 

6.  adaptability  to  a  pilot's  learning  style; 

7.  cue  development  and  reinforcement  capability; 

8.  feedback  and  guidance  capability; 

9.  performance  measurement  capability; 

10.  diagnostic  capability;  and 

11.  capability  for  self-administration. 

Of  course,  the  ultimate  criterion  for  assessing  the  value  of  any  continuation 
training  medium  is  the  extent  to  which  skills  practiced  via  the  mediun 
transfer  to  the  aircraft. 


CONCLUSIONS 


Based  on  the  results  presented  and  the  discussion  and  implications  thereof,  a 
number  of  general  conclusions  can  be  drawn. 

1.  Recently  certificated  private  pilots  who  do  not  fly  regularly  can  be 
expected  to  undergo  a  relatively  rapid  and  significant  decrement  In  their 
flight  skills.  Further,  such  decranent  will  affect  most  flight  tasks  that  are 
required  of  the  private  pilot. 

2.  The  effect  of  interpolated  flight  training  is  to  forestall  (not 
prevent)  skill  decranent, 

3.  Instrument  training,  properly  conducted,  can  exert  positive  effects 
on  the  retention  of  both  contact  and  instrument  flight  tasks. 

4.  Greater  and  more  pervasive  performance  decrements  may  be  expected  for 
flight  tasks  that  require  appreciable  coordination  between  cognitive  and 
control  skills. 

5.  Written  test  (i.e.,  knowledge)  scores  decrease  significantly  during 
the  8-mor(th  period  following  certification;  however,  written  test  scores  are 
not  usefi.1  for  predicting  actual  flight  performance. 

6.  Private  pilots  who  do  not  fly  frequently  need  periodic  diagnostic 
assistance  to  help  them  pinpoint  specific  flight  tasks  on  which  they  need 
continuation  training. 

7.  Continuation  training  methods  should  be  skill-specific  and  emphasize 
the  development  and  reinforcement  of  cognitive  cues. 

8.  An  urgent  need  exists  for  the  development  of  more  effective  perfor¬ 
mance  criteria  and  of  continuation  training  methods  designed  to  aid  private 
pilots  in  meeting  those  criteria. 
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APPENDIX  A 


HANDBOOK  FOR  THE  USE  OF  THE 
PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR) 

AND 

PILOT  PERFORMANCE  DESCRIPTION  RECORD 


This  appendix  contains  a  copy  of  the  handbook  used  to  standardize  the  check- 
pilot  In  the  use  of  the  Pilot  Perforroance  Description  Record  (PPDR).  The 
handbook  gives  Instructions  concerning  the  mechanics  of  administering  the  PPDR 
and  defines  performance  measures  used  In  the  29  PPDR  flight  tasks.  Also  con¬ 
tained  In  this  appendix  Is  a  copy  of  the  PPDR  that  was  used  to  record 
subjects'  In-flight  performance  for  the  private  pilot  checkrlde  and  the  8-, 
16-,  and  24-month  retention  checks.  Procedures  as  to  how  the  PPDR  was  used 
are  described  In  the  METHOD  section  of  the  report.  Table  1  of  that  section 
lists  the  flight  tasks  contained  In  the  PPDR. 
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HANDBOOK  FOR  THE  USE  OF  THE 
PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR) 


I.  Purpose 

A.  General  -  to  provide  a  method  of  clearly  describing  and  documenting 
student  pilot  performance 

B.  Specific  -  to  provide  objective  performance  data  for  evaluating 
Contact  performance  of  students  In  various  training  tracks. 

II.  Guiding  Principles 

A.  to  obtain  a  maximum  of  descriptive  and  specific  judgmental 
Information  with  a  minimum  of  in-flight  marking 

B.  to  be  made  compatible  with  existing  FAA  and  E-RAU  checkrlde 
procedures 

III,  PPDR  Characteristics  and  General  Utilization 

A.  Each  flight  task  in  this  PPDR  has  been  analyzed  and  discussed  with 
E-RAU  personnel  to  determine  its  fundamental  components.  The  anal¬ 
yses  provided  the  basis  for  the  development  of  descriptive  and 
judgmental  scales  on  which  each  performance  component,  such  as  direc¬ 
tion,  attitude,  power,  and  flight  path,  could  be  quickly  described  by 
the  checkpilot, 

B.  This  PPDR  includes  a  sample  of  the  flight  tasks  described  in  the  FAA 
flight  test  guide  on  which  proficiency  must  be  demonstrated  to  pass 
the  checkrlde  for  the  Private  Pilot  license.  This  PPDR  Is  Intended 
to  provide  descriptive  data  for  this  sample  only.  Administration  of 
this  PPDR  should  not  restrict  or  constrain  the  checkpilot' s  usual 
checkrlde  prerogatives.  In  particular,  in-flight  safety  must  not  be 
jeopardized,  although  the  sequence  of  PPDR  tasks  should  be  standard¬ 
ized  as  described  in  E.  below.  The  performance  description 
resulting  from  this  PPDR  is  considered  to  be  as  complete  as  can  be 
obtained  efficiently  by  manual  recording  during  a  single  flight 
period. 

C.  In  any  data  collection  effort,  rel 1 abil i ty  (meaning  consistency  or 
repeatability  of  test  result),  and  validity  (meaning  measuranent  of 
that  which  is  Intended  to  be  measured]  are  desirable  goals.  One 
necessary  factor  in  achieving  high  levels  of  reliability  and  validity 
Is  standardization  of  the  test  sample,  test  conditions,  and  methods 
of  data  record ingT  The  standardization  of  the  flight  test  sample  and 
the  methods  for  administering  and  evaluating  it  Is  the  aim  of  the 
PPDR. 

D.  This  PPDR  is  separated  into  29  flight  tasks  to  be  recorded.  Where 
applicable,  each  task  is  divided  into  segments  that  specify 
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observations  that  are  to  be  made  as  objectively  as  possible.  During 
a  flight  check,  student  performance  normally  Is  recorded  during  or 
near  the  end  of  each  segment,  provided  that  performance  is  within  the 
limits  specified  as  "proper*  on  all  scales  In  that  segment.  Whenever 
an  error  exceeding  "proper  limits"  of  a  scale  occurs,  the  checkpilo: 
should  record  it  immediately,  regardless  of  how  much  of  the  segment 
is  completed.  If,  later  In  the  segment,  the  student  exceeds  his  pre¬ 
vious  error  on  the  same  scale,  the  checkpilot  makes  a  second  mark 
farther  out  on  the  scale.  Generally  speaking,  erratic  performance  is 
reflected  by  multiple  marking;  for  example.  If  the  descent  rate 
during  an  approach  is  uneven,  both  "slow"  and  "fast"  may  be  marked. 

There  are  three  general  levels  of  detail  represented  In  the  PPDR: 
11)  individual  performance  measures,  (2)  flight  segments,  and  (3) 
flight  tasks.  Segments  and  measures  are  listed  in  the  approximate 
sequence  In  which  they  occur  during  execution  of  the  task.  This  is 
Intended  to  simplify  and  standardize  in-flight  data  recording. 

Individual  Performance  Measures.  The  PPDR  measuring  scales  show 
the  detailed  and  descriptive  criteria  of  student  performance  which 
underlie  the  evaluation  made  by  the  checkpilot.  Examples  of  these 
scales  are  RPM,  airspeed,  altitude,  and  ground  track.  These  scales 
are  recorded  objectively  by  the  checkpilot  from  Instruments  or 
clearly  definable  outside  references.  However,  it  is  not  always 
possible  to  find  such  outside  references  for  certain  crucial  aspects 
of  student  performance.  Consequently,  a  few  scales  are  judgmental  in 
nature,  e.g.,  pattern  exit  or  control  smoothness.  The  checkpilot 
must  use  his  judgment  in  evaluating  and  recording  these  Items. 

Flight.  Segments.  The  subdivision  of  each  PPDR  flight  task  into 
its  segments  is  Indicated  by  single  horizontal  lines  between 
segments.  The  segment  breaks  serve  to  remind  the  checkpilot  of  the 
time  required  for  that  particular  group  of  measures.  More  impor¬ 
tantly,  they  make  it  easier  for  the  checkpilot  to  focus  on  a  par¬ 
ticular  group  of  measures  for  the  specific  portion  of  flight 
performance  being  recorded.  This  reduces  the  difficulty  in  deter¬ 
mining  the  flight  performance  sample  to  which  each  measure  applies. 
Occasionally,  a  measure  refers  only  to  a  specific  part  (beginning  or 
end)  of  a  segment;  but  these  instances  will  be  obvious  to  the  check- 
pilot.  Segments  and  measures  are  sequenced  from  the  top  of  the  page 
to  the  bottom. 

Flight  Tasks.  There  are  several  factors  about  the  selected 
flight  tasks  that,  the  PPDR  seeks  to  control.  One  factor  is  the  spe¬ 
cification  of  performance  measures  and  segments  within  tasks.  The 
PPDR  also  requires  tr  it  all  students  perform  identical  tasks,  which 
ensures  that  the  same  behavioral  patterns  are  sampled  In  all  stu¬ 
dents.  Because  the  sequence  in  which  tasks  are  given  during  a  flight 
check  can  affect  the  results,  the  sequence  for  the  PPDR  has  been 
standardized.  The  sequence  which  has  been  settled  upon  should  allow 
for  maximum  use  of  available  time  and  resources.  Due  to  the  require¬ 
ment  for  economy  of  time  and  effort  in  conducting  the  checkride,  the 
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task  performance  sequence  may  be  varied  somewhat  to  expedite  or  to 
Increase  Its  efficiency  or  convenience.  However,  this  standardized 
sequence  should  be  followed  as  closely  as  possible.  All  tasks  must 
be  completed  for  each  checkriae,  conditions  permitting. 

F.  PPDR  reliability  Is  dependent  upon  the  degree  of  standardization 
achieved  in  administering  checkrides.  It  is  essential  that  the 
checkpilot  thoroughly  understand  each  PPDR  measure  and  Its  definition 
as  described  in  this  handbook.  As  a  recorder,  he  is  asked  to  provide 
accurate  and  descriptive  information  on  the  observed  performance 
as  ft  occurs.  The  recording  function  is  extremely  critical  to  the 
PPDR  data  collection  effort,  To  achieve  the  goal  c*  accuracy  and 
completeness  of  recording,  the  subject's  performance  should  be 
recorded  as  soon  after  it  occurs  as  is  practical,  with  due 
consideration  for'  safety. 

G.  Tire  chockpilot  should  maintain  an  impartial  attitude  toward  the  stu¬ 
dent,  limiting  conversation  to  explaining  checkride  requiranents  and 
conditions. 


H.  The  pilot  subject  should  not  be  given  detailed  feedback  relative  to 
checkride  performance  prior  to  debriefing. 


I.  Measures  included  in  this  PPDR  are  of  two  types; 


Performance  Scales  with  a  desired  range  of  values  Indicated  by  a 
triangular  symBol  at  the  scale  midpoint,  and  errors  ie.g,,  left/ 
right)  to  either  side  of  the  triangle,  For  some  measures  a  desired 
value  is  specified  at  the  top  of  the  triangle.  Other  measures 
include  a  ‘O'  above  the  triangle.  Indicating  that  the  checkpilot  must 
determine  the  correct  desired  value  depending  upon  the  aircraft, 
airspace,  or  prevailing  conditions. 


Categorical  Measures  (yes  or  no)  requiring  the  checkpilot  to 
determine  whether  or  not  the  observed  performance  Is  within  accep¬ 
table  limits.  This  determination  involves  snore  complex  judgment  for 
some  measures  (e.g.,  constant  turn  radius)  than  others  (e.g.,  full 
throttl e) . 


J.  For  the  scale  measures  that  include  a  specified  deviation  range 
(l.e.,  tolerance)  around  the  midpoint,  the  tolerance  band  specified 
may  or  may  not  be  identical  to  the  standards  given  In  the  FAA  flight 
test  guide.  These  bands  are  not  necessarily  intended  to  denote  FAA 
acceptable  performance,  but  rather  to  generate  accurate  data  to 
document  observable  performance  differences. 


K.  This  version  of  the  PPDR  is  no'-  Intended  for  use  In  diagnosing  stu¬ 
dent  performance  deficiencies.  However,  research  has  shown  that  use 
of  the  PPDR  can  lead  to  such  diagnosis  by  providing  Instructors, 
checkpllots,  and  training  managers  with  a  valid  and  reliable  perfor¬ 
mance  data  base  describing  typical  and  atypical  student  performance. 
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These  date,  my  then  be  used  as  an  Index  cf  comparison  (norm)  for  any 
given  student's  observed  performance,  and  therefore  provide  effective 
performance  feedback  to  tnat  student. 

PPDH.  Data  Re  core"  inc, 

A.  The  cover  page  of  the  PPOR  Is  divided  into  three  parts.  Part  One 
contains  descriptive  information  about  the  student,  checkpllot, 
aircraft,  etc,  end  should  be  completed  in  its  entirety  prior  to  the 
chc'kride.  Part  Two  contains  weather  data.  The  direction  and 
velocity  of  c-rosswind  is  well  as  existing  turbulence  shoal d  be 
recorded  both  before  and  after  the  checkrlde. 

B.  Each  scale  joould  marked  with  at  least  one  slash  mark  of  approx¬ 
imately  1/4  inch  *•,  >r»:ith.  The  m?.rk  should  pass  clearly  and  evenly 

through  the  $c  '  v.;-  -  that  there  Is  no  doubt  about  which  scale  or 

which  portion  of  the  checkpllot  intended  to  mark.  Cate¬ 

gorical  measures  should  include  a  slash  mark  in  the  appropriate  box. 

C.  For  those  segments  encompassing  an  extended  period  of  time  (e.g., 

cllmbout  and  pattern  exit  after  takeoff),  multiple  marks  may  be 

necessary.  This  gives  a  record  of  deviations  as  they  are  observed 
without  forcing  the  cbeckpilot  to  rely  upon  his  memory  of  an  extended 
performance  segment .  Errors  observec  in  both  directions  (e.g.,  low 
ana  high)  should  be  appropriately  recorded.  Short  term  segments 
Te.g.,  flare)  should  include  only  one  mark  for  each  measure. 
Requirement  for  multiple  mar  king  should  be  apparent  to  the 

checkpllot. 


D.  If  dangerous  performance  occurs,  the  checkpllot  should  write  a  letter 
"D"  In  the  left  margin  and  draw  a  line  to  the  scale(s)  reflecting  the 
dangerous  performance.  If  a  flight  task  is  aborted  because  of 
student- induced  dangerous  performance,  an  additional  notation  should 
be  made  in  the  margin  and  all  remaining  measures  on  that  task  marked 
in  error. 

E.  If  the  checkpilot  finds  it  necessary  to  assist  the  subject  with  a 
task,  "CP  Assist"  should  be  noted  in  the  margin  for  the  affected 
portion  of  the  task  or  segment. 

F.  Go-ammds  and  their  reason  should  be  noted  in  the  margin  (except 

when  the  go- around  task  is  being  assessed).  When  a  go- around  is  Ini¬ 
tiated  for  any  reason,  the  checkpllot  shall  note  the  go-around  point 
on  the  PPDR,  allow  one  additional  approach,  and  begin  marking  at  the 
point  of  go-around.  If  erratic  student  performance  necessitates  e 
second  go-around,  <°i  remaining  PPDR  measures  shall  be  marked  in 
error,  and  PPDR  recorulng  shall  terminate.  If  the  go-arounds  are,  in 
the  judgment  of  the  checkpllot,  weather  or  traffic-induced,  a  nota¬ 
tion  to  that  effect  should  be  made  in  the  margin,  and  remaining 
measures  left  unmarked.  '  ‘  ' 
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PPDR  MEASURE  DEFINITIONS  AND  RECORDING  GUIDELINES 


The  PPDR  provides  a  record  of  what  actually  occurs  during  the  checkrtde.  The 
flight  tasks  included  in  this  PPDR  arc*  intended  to  be  performed  under  normal 
private  pilot  checkrlde  conditions  (i.e.,  no  more  than  light  to  moderate  wind 
and  turbulence  effects).  As  such,  the  PPDR  tasks  should  not  be  deliberately 
assigned  under  extremely  windy  or  turbulent  conditions.  However,  if  it  is 
necessary  to  administer  the  PPDR  In  such  conditions,  an  accurate  recording  of 
the  characteristics  of  those  conditions  before  and  after  the  checkrlde  will 
enable  them  to  be  considered  in  the  overall  analysis  of  performance.  The 
checkpilot  must  j^ot  allow  extraneous  factors  to  Influence  his  marking  of  the 
actual  performance  scales.  However,  he  may  note  that  extraneous  factors  have. 
In  his  judgment.  Influenced  the  performance  of  a  task. 

Measures  are  of  two  general  types.  One  is  a  scale  with  a  triangle  provided  at 
its  midpoint.  The  triangle  should  be  marked  if  performance  Is  within  nonerror 
limits  (I.e.,  proper) .  Otherwise,  deviations  from  these  limits  should  be 
marked  in  the  appropriate  error  direction  (e.g.,  low  or  high).  Recording 
should  not  attempt  to  reflect  the  exact  number  of  units  of  deviation  from  the 
midpoint  (e.g.,  both  7  knots  and  9  knots  should  be  marked  midway  between  5  and 
10  knots) . 

The  other  measure  is  categorical,  requiring  the  checkpilot  to  mark  either 
“yes"  or  "no,"  depending  or.  whether  the  observed  performance  relative  to  that 
measure  was.  In  his  judgment,  acceptable.  Measure  definitions  should  be 
followed  in  this  determi nation. 

PERFORMANCE,  MEASURES. 

Abeam  Midpoint  -  On  traffic  rattern  entry,  mark  "Yes"  if  entry  is  within  an 
acceptable  range,  made  abtam  the  midpoint  of  the  runway;  otherwise,  mark 
"Nc. 

Acceptable  Rotation  -  If  takeoff  rotation  Is  smooth  and  correctly  timed,  mark 
"Ves";  otherwise,  mark  "No." 

Airspeed  -  If  observed  airspeed  is  within  1.5  knots  of  the  desired  airspeed, 
proper  should  be  marked;  otherwise  the  direction  and  magnitude  of  error 
should  be  marked. 

A1  ti tude  -  If  observed  altitude  Is  vithin  j_50  feet  of  desired  altitude,  mark 
proper;  otherwise,  mark  direction  and  magnitude  of  error. 

AltUude  Loss  Acceptable  -  A  measure  .if  stall  recovery  skill,  mark  “Yes"  If 
aTtilu'de  loss  during  recovery  Is  ,iot  greater  than  50  feet;  If  altitude 
loss  Is  judged  excessive,  mark  "No.'' 

Angle  (45°)  -  Traffic  pattern  entry  track  angle  should  be  marked  "Yes"  if 
entry  is  made  at  approximately  a  45°  angle;  otherwise,  mark  "No." 


Approach  Angle  -  If  the  approach  to  landing  Is  judged  to  be  within  approximate 
range  of  the  desired  approach  angle,  mark  proper;  otherwise,  mark  whethe* 
the  angle  is  too  ''shallow'1  or  too  "steep." 

Bank  -  When  turning,  if  the  desired  bank  angle  Is  maintained  within  15° , 
proper  should  be  marked;  otherwise,  the  direction  and  magnitude  of  error 
should  be  marked. 


Carb  Heat  Off  -  Mark  "Yes"  or  "No"  as  appropriate. 

Cockpit  Check  -  If  all  required  cockpit  procedures  are  satisfactorily  per- 
formed,  mark  "Yes";  otherwise,  mark  "No." 

Constant  Radius  Turn  -  A  measure  of  wind  drift  correction  in  turns  about  a 
point,  marie  "Yes"  if  the  turn  radius  is  approximately  equal  throughout 
both  turns:  If  the  ground  path  is  erratic  or  if  the  turns 


are  smooth  but  drift  corrections  are  improper. 


mark  "No." 


Contact  -  Mark  proper  if  landing  contact  with  the  runway  Is  correctly  timed 
and  smooth;  otherwise,  mark  whether  the  aircraft  was  "dropped"  or 
"bounced." 

Control  Coordination  -  A  measure  of  general  control  skill,  mark  "Yes"  if 
student  maintains  coordinated  flight  (1.1  ball)  during  turn.  Otherwise, 
mark  "No." 


Degrees  Turned  -  Mark  proper  if  the  observed  number  of  degrees  turned  is 
within  I50  of  the  aesfred  number  of  degrees  turned;  otherwise,  mark  the 
direction  and  magnitude  of  error. 

Descent  Rate  -  If  the  observed  descent  rate  is  judged  to  be  within  approximate 
range  of  the  desired  descent  rate  (e.g.,  500  fpm),  mark  proper;  other¬ 
wise,  mark  the  direction  of  error  ("slow"  or  "fast"). 

Distance  Out  -  Mark  proper  if  the  traffic  pattern  is  entered  at  the  correct 

“  Hi" stance  from  the  runway;  otherwise,  indicate  whether  entry  is  "too 

'■  close"  or  “too  f*r:*  from  the  runwpy. 

Enter  Downwind  -  Mark  "Yes1'  if  entry  is,  within  acceptable  limits,  In  a 
iJownwi  nF'di  recti  on;  otherwi se,  mark  "No." 
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Flaps  ( 1C* )  -  Mork  "Yes'  or  "No"  02  appropriate. 

Full  Flaps  ..  Mark  "Yes"  or  "Wo"  as  appropriate. 

Full  Throttle  -  If  throttle  is  fwl  1  open,  mark  "Yes";  any  throttle  setting 
less  than  full  should  be  1  ''No,"  •  / 


Heading  -  Mark  proper  If  observed  heading  is  within  i.50  of  desired  heading: 
otherwise,  mark  direction  and  magnitude  of  error. 

Level-off  Altitude  -  Traffic  pattern  or  assigned  level-off  altitude,  If 
achieved  within  1.50  feet,  should  be  marked  proper;  otherwise,  the  direc¬ 
tion  and  magnitude  of  error  should  be  markeaT- 

Maintain  Airspace  Scan  -  If  student  scans  (with  visible  head  movement)  for 
other  aircraft,  mark  "Yes";  otherwise,  mark  "No." 

Mixture,  Full  Rich  -  Mark  "Yes"  or  "No"  as  appropriate. 

Pitch  Decreased  -  A  component  of  stall  recovery  skill,  mark  "Yes"  if  nose-up 
pitch  i s  properly  and  immediately  decreased  after  stall  occurs;  other¬ 
wise,  mark  "No." 

Power,  Idle  -  Mark  "Yes"  or  "No"  as  appropriate. 

Proper  Entry  Sequence  -  If  all  necessary  procedures  are  performed  in  the 
correct  sequence  during  entry,  mark  "yes";  if  any  procedure  is  omitted  or 
out  of  sequence,  mark  "No". 

Proper  Flaps  -  If  the  flaps  are  set  in  the  desired  or  assigned  configuration, 

~ **  **  hov'i.H  r  n  rn  V* l /  •U'A  11 
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Proper  Flare  Attitude  -  Mark  proper  if  the  aircraft  is  in  the  correct  nose-up 

~~  pitch  attitude  during  the  flare;  otherwise,  mark  the  direction  of  error 
("nose  low"  or  "nose  high"). 

Proper  Flare  Rate  -  Mark  proper  if  the  flare  rate  is  within  proper  limits 
given  existing  condi Lions;  otherwise,  mark  whether  the  flare  was  too 
"slow"  or  too  "fast." 

Proper  Ground  Track  -  If  the  aircraft  is  maintained  within  an  acceptable  range 
of  the  desired  ground  track  throughout  a  segment,  mark  "Yes'1;  otherwise, 
mark  "No." 

Proper  Pattern  Exit  -  When  exiting  the  traffic  pattern,  mark  "Yes"  if  exit  is 
timely,  at  The  proper  location,  altitude,  and  correct  angle.  If  any  one 
of  these  conditions  Is  not  satisfied,  mark  ^o." 

Proper  Recovery  Sequence  -  If  all  necessary  procedures  are  performed  in  the 
correct  sequence  during  recovery,  mark  "Yes";  if  any  procedure  Is  omlttwd 
or  out  of  sequence,  mark  "No." 

Radial  Identified  -  If  student  can  correctly  Identify  radial  aid  orient 
accordingly,  mark  "Yes";  otherwise,  mark  "No." 

Reduce  Power  -  If  power  is  reduced  within  a  proper  time  range,  mark  proper; 
otherwise,  mark  whether  power  was  reduced  too  "early"  or  tao  "late*  In 
the  traffic  pattern. 
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RPH  -  If  the  desired  RPM  setting  is  maintained  within  1.50  RPM,  proper  should 
be  marked;  otherwise,  the  direction  and  magnitude  of  error  IKould  be 
marked. 

Runway  Center! i no  Track  -  This  is  a  measure  of  directional  control  during 
"talceoTT  and"  1  and 'mg  ground  roll  and  should  be  marked  proper  as  long  as 
the  runway  centerline  is  within  the  wing  tips.  Deviations  from  cen¬ 
terline  ("left"  or  "right")  should  be  marked  if  the  wingtip  opposite  the 
direction  of  deviation  passes  the  runway  centerline. 

Smooth  Control  -  If  control  movements  are  judged  smooth  and  coordinated  for 
_aT )  segments  of  the  maneuver,  mark  ‘‘Yes.’'  If  any  segment  contains 
control  movements  that  are  erratic,  of  excessively  large  magnitude  or 
frequency,  or  otherwise  unacceptable,  mark  "No." 

Stall  Recognized  -  Timely  and  correct  recognition  of  stall  should  be  marked 
"Ye s" ;  o therwi se ,  mark  "No." 

Station  Identified  -  If  the  student  can  correctly  identify  the  VOR  station 
within  an  acceptable  time  period,  mark  "Yes";  otherwise,  mark  "No." 

Station  Tuned  Properly  -  If  correct  YOR  station  is  correctly  tuned  within  an 
acceptable  time  period,  mark  "Yes";  otherwise,  mark  "No." 

Track  from  Extended  Runway  -  A  measure  of  track  control  after  liftoff  and 
during  approach  to  landing,  proper  should  be  marked  if  the  aircraft  track 
is  maintained  within  an  acceptabl e  track  width  from  ground  level  to  an 
altitude  of  500  feet  or  until  a  turn  is  correctly  initiated.  If,  in  the 
checkpilot's  judgment,  proper  track  is  not  maintained  during  climbout  or 
approach,  "left"  or  "right"  should  be  marked. 

Touchdown  Point  -  If  the  aircraft  touches  down  within  an  acceptable  range  of 
the  desired  touchdown  point,  mark  proper;  otherwise,  mark  whether  the 
observed  touchdown  is  short  or  long  ret aTive  to  the  desired  or  assigned 
touchdown  point  range. 

Trim  -  A  measure  of  ability  to  trim  for  hands-off  flight,  mark  "Yes"  if  little 
or  no  control  is  required  to  maintain  level  flight;  otherwise,  mark  "No." 

Turn  to  Inbound  Heading  -  If  inbound  heading  is  achieved  within  ±5°  of  that 
assigned,  mark  proper;  otherwise,  mark  the  direction  and  magnitude  of 
error. 

Turn  Started  -  A  measure  of  traffic  pattern  skill,  mark  proper  if  the  turn  is 
TnTtTated  within  an  acceptable  distance  of  the  desired  or  assigned 
turning  point;  otherwise,  mark  whether  the  turn  was  initiated  too  "early" 
or  too  "late." 

VOR  Track  -  Mark  proper  if  the  CDI  needle  is  maintained  within  i  1  dot  of  the 
circle  for  the  duration  of  the  track;  otherwise,  mark  the  direction  and 
magnitude  of  error. 
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PILOT  PERFORMANCE  DESCRIPTION  RECORD 


ENGINE  RUNUP  AND  BEFORE  TAKEOFF  CHECK 


BEFORE  TAKEOFF  PROCEDURES  CORRECT  pTET!  {  RcTf 

(If  any  step  is  omitted  or  performed  incorrectly,  please  list  it  below.) 


COMMENTS : 


A- 1 1 


TAKEOFF  AND  DEPARTURE 


GROUND  RUN 

FULL  THROTTLE 

rrcn  nan 

RUNWAY  CENTERLINE  TRACK 

LEFT 

RIGHT 

LIFTOFF 

55 

AIRSPEED 

LOW 

-5  a  +5 

HIGH 

ACCEPTABLE  ROTATION 

rron  rwn 

CLIMBOUT 

AIRSPEED 

LOW 

-5  a  +5 

LdtSk. 

HIGH 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

RIGHT 

PROPER  PATTERN  EXIT 

nrerf  rm 

PROPER  TRIM  (FOR  CLIMB) 

nrrf  rm 

LEVEL  OFF 

ALTITUDE 

LOW 

-50  +50 

HIGH 

TRIM  (LEVEL  FLIGHT) 

nrn  ruin 

SMOOTH  CONTROL 

i~Ym  rm 

CONTROL  COORDINATION 

him  pyn 

r^m  r^im 

TURBULENCE 

nrn  n«n 

COMMENTS: 
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|  SHORT  FIELD  TAKEOFF  j 
GROUND  RUN 

FULL  THROTTLE  Dm  cm 

RUNWAY  CENTERLINE 
TRA.CK 

LIFTOFF 

AIRSPEED 

ACCEPTABLE  ROTATION 

CLIMBOUT 

-3  ^  I'D 

INITIAL  AIRSPEED  (OVER  OBSTACLE)  LOW  HIGH 


-5  +5 

LOW  litrifjfcfrj  HIGH 

tun  cm 


LEFT_  1  RIGHT 


+5 


AIRSPEED  (AFTER  OBSTACLE  CLEARED)  LOW  \  1  HIGH 


TRACK  FROM  EXTENDED  RUNWAY 

LEFT 

Ldrtfted  RIGHT 

PROPER  TRIM  (FOR  CLIMB) 

an 

]  Dun 

LEVEL  OFF  (IN  PATTERN) 

ALTITUDE 

LOW 

U«SmJ  high 

TRIM  (LEVEL  FLIGHT)  |~YC5~f  pTKTf 


SHORT  FIELD  TAKEOFF 


SMOOTH  CONTROL 


rron  rm 


CONTROL  COORDINATION 


\jm 


pLTQ  □gTOj 


TURBULENCE 


LM3  BO 


COMMENTS: 


A- 1 4 


SOFT  FIELD  TAKEOFF 


GROUND  RUN 


PROPER  USE  OF  FLAPS 

QE1 

cm 

INITIATED  ROLLING  START 

Qm 

rm 

FULL  THROTTLE 

TVETl 

cm 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

right 

LIFTOFF 

-5  +5 


AIRSPEED  AT  LIFTOFF 

ACCEPTABLE  ROTATION 

CLIMBOUT 

MAINTAINS  PROPER  ATTITUDE  UNTIL 
AIRSPEED  BUILDS 

AIRSPEED  (AFTER  STARTING 
CLIMBOUT) 


LOW  UgBRfeJ  HIGH 


am  am 


r~Ynrf  run 

-5  +5 

LOW  jJbL  HIGH 


TRACK  FROM  EXTENDED  RUNWAY 
PROPER  TRIM  (FOR  CLIMB) 


LEFT  _ RIGHT 

am  am 
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LEVEL  OFF  {IN  PATTERN ) 


ALTITUDE 

LOW 

HIGH 

TRIM  (LEVEL  FLIGHT) 

Dm 

c 

BIT| 

SMOOTH  CONTROL 

Dm 

c 

SO 

CONTROL  COORDINATION 

Dm 

q 

m 

fStTF] 

fsAu  [ 

TURBULENCE 

prtTf 

rm 

COMMENTS: 


CROSSWIND  TAKEOFF 


GROUND  RUN 

FULL  THROTTLE  f7FS~f  {~Wf 

FULL  AILERON  DEFLECTION  HTTf  TOH 

RUNWAY  CENTERLINE  TRACK  LEFT  _  RIGHT 

LIFTOFF 
AIRSPEED 

ACCEPTABLE  ROTATION 
PROPER  DRIFT  CORRECTION 

CLIMBOUT 

-b  ^  +b 

AIRSPEED  LOW _ UttBteJ _ HIGH 

TRACK  FROM  EXTENDED  RUNWAY  LEFT  — _  RIGHT 

PROPER  TRIM  (FOR  CLIMB)  fTTH 


-5  +5 

^ I  I _ HIGH 

□m  03 

to  rm 


LEVEL  OFF 

ALTITUDE  LOW _ |  I 

TRIM  (LEVEL  FLIGHT)  pT5~  1  OH 


SMOOTH  CONTROL  flTTf  |  N0[ 


COMMENTS: 
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STRAIGHT  AND  LEVEL  FLIGHT 


AIRSPEED 

-10 

i 

105 

-5^£^+5 

+10 

1 

HEADING 

-10° 

1 

-5°  A  +5° 

+10° 

I 

ALTITUDE 

-10Q 

I 

-50  ^  +50 

+100 

l- 

PROPER  TRIM 

□m 

J-W] 

SMOOTH  CONTROL 

fYF5"f 

cm 

TURBULENCE 

pTETf 

n«n 

COMMENTS 


S"  TURNS  ACROSS  A  ROAD 


[ - 1 


ENTERS  DOWNWIND 

pTTj 

cm 

l*t  TURN 

ALTITUDE 

-100 

i 

-■50  A  *,50 

. 

+100 

1 

AIRSPEED 

-10 
_  1 

-5  +5 

LtftiflifelkJ  ... 

+10 

1 

CORRECT  BANK  ANGLES 

[7£5“[ 

cm 

FOR  DRIFT  CORRECTION 

WINGS  LEVEL  AT  ROAD 

Dm 

cm 

2"<1  TURN 

ALTITUDE 

-100 

1 

~5Q  ^  +50 

+100 

1 

AIRSPEED 

-10 

l 

-5  ^  +5 

A  i  _ 

+10 

1 

CORRECT  BANK  ANGLES 

cm 

FOR  DRIFT  CORRECTION 

pTTj 

SMOOTH  CONTROL 

am 

rm 

COORDINATED  TURNS 

om 

cm 

TURBULENCE 

om 

ps&i 

COMMENTS: 
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ENTER  DOWNWIND 


pin  nm 


1st  TURN 

ALTITUDE 

AIRSPEED 

— 

-100 

_1  _ 

-10 

1 

-50  +50  *• 

_ _ 

-5  +5  + 

2nd  TURN 

-100 

-50  ^ 

+50  + 

ALTITUDE 

— 

i 

■  ■  l  _ 

-  muHi 

1 

-10 

-5  ^ 

+5  + 

AIRSPEED 

— 

_i  - 

_ui 

mJ - 

COMSTANr  RADIUS 

TURN 

prrj 

an 

PROPER  EXIT 

-10° 

-5°  . 

+5°  + 

HEADING 

— 

MAINTAIN  AIRSPACE  SCAN 

pm 

OH 

SMOOTH  CONTROL 

Dm 

pun 

TURBULENCE  QTT]  f~HQ~f 


COMMENTS: 


MINIMUM  CONTROLLABLE  AIRSPEED 


ENTRY 

PROPER  ENTRY  PROCEDURES 
STRAIGHT  AND  LEVEL 

AIRSPEED 

ALTITUDE 

HEADING 

TURN 

AIRSPEED 

ALTITUDE 


RECOVERY 

PROPER  RECOVERY  PROCEDURES 

PROPER  USE  OF  POWER 

SMOOTH  CONTROL 
TURBULENCE 


COMMENTS: 


1 


cm 

rm 

“  ‘  •*;  • . 

-10 

+5 

kJ 

+10 

-100 

^50 

+100 

-10* 

_l 

_ ^ 

+5” 

+10° 

(_ 

cm  cm 
cm  cm 

rrtrr  mm 

cm  cm 
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ENTRY 


PROPER  ENTRY  PROCEDURES 

AIRSPEED 


RECOVERY 


STALL  RECOGNIZED 

fW) 

cm 

PITCH  DECREASED 

r^n 

rum 

NINGS  LEVEL 

flTTf 

rm 

ALTITUDE  LOSS  ACCEPTABLE 

pTTf 

rwn 

AIRSPEED  NOT  EXCESSIVE 

pTTf 

pq 

SMOOTH  CONTROL 

QE53 

purl 

TURBULENCE  fTETf  H^H 


tHH  CM 

55 


COMMENTS: 


APPROACH  TO  LANDING  STALL 


ENTRY 

PROPER  ENTRY  PROCEDURES  PiTTt  t~Wt 

55 

-5  a  +5 

AIRSPEED  LOW _ _ HIGH 

-5®  A  +5° 

BANK  SHALLOW  _ STEEP 


RECOVERY 


STALL  RECOGNIZED 

QR] 

on 

FULL  THROTTLE 

03 

03 

PITCH  DECREASED 

Dm 

cm 

WINGS  LEVEL 

am 

□El 

CARB  HEAT  OFF 

□m 

cm 

FLAP  RETRACTION 

PrETf 

03 

ALTITUDE  LOSS  ACCEPTABLE 

pTTf 

cm 

AIRSPEED  NOT  EXCESSIVE 

on 

cm 

SMOOTH  CONTROL 

03 

cm 

TURBULENCE 

pTTf 

03 

COMMENTS: 
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ENGINE  FAILURE  PROCEDURES  DURING  FLIGHT 


ENGINE  FAILURE  PROCEDURES  CORRECT 

pfrq 

CM3 

AIRSPEED  -  65  KIAS  (±  2  KNOTS) 

cm 

CARB  HEAT  ON 

m 

FUEL  SELECTOR  VALVE  ON  BOTH 

m 

MIXTURE  RICH 

m 

IGNITION  SWITCH  ON  BOTH 

m 

PRIMER  -  IN  AND  LOCKED 

i — r 

COMMENTS: 
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STEEP  TURNS  (720*) 


ENTRY 


PROPER  ROLL IN 

fTETj 

|~WI 

PROPER  USE  OF  POWER 

rrcq 

P®1 

AIRSPEED 

-10 

1 

lJLj 

+10 

l 

ALTITUDE 

-100 
_ l 

-50^50 

LdBiSlBtei 

+100 

L_ 

STEEP  TURNS  (720°) 


RECOVERY 

PROPER  LEAD 

rrrrf  rwf 

ALTITUDE 

-100 

1 

-50  ^  +50 

+100 

1 

HEADING 

-20° 

1 

-10°  ^  +10° 

+20° 

l 

AIRSPEED 

-10 

95 

+10 

1 

PROPER  POWER  REDUCTION 

pits  i  pTfiri 

SMOOTH  CONTROL 

rm  n«n 

TURBULENCE 

rmi  rwi 

COMMENTS: 
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ft  h  i~“'  ~rrrai  mi  ‘rmiii1 —  • 


—  — -  -  -  — — 

ACCELERATED  STALL 


ENTRY 


AREA  CLEARED 

rrert  pun 

MIXTURE  RICH 

os  mm 

POWER  (RPM) 

-100 

1 

-.50  A  fO 

+100 

1 

ALTITUDE 

-100 

+100 

1 _ 

BANK 

INITIATE  AT  E.S  KIAS  (±  S  KNOTS) 

mi  run 

BANK  ANGLE 

-1Q® 
_ 1 

-5°  A  +5° 

+10“ 

1 

ALTITUDE 

-100 

1 

_ L 

-50A+50 

L4AWBl 

gfcL-  ■ 

+100 

1 

RECOVERY 


STALL  RECOGNIZED 

pTTj 

as 

PITCH  DECREASED  PROPERLY 

QH1 

rwi 

WINGS  LEVELLED  PROPERLY 

OS 

1  W 1 

FULL  POWER 

as 

rs 

GARB  HEAT  COLD 

nrn 

as 

PROPER  CONTROL 

COORDINATION 

as 

rs 

SMOOTH  CONTROL 

as 

TURBULENCE 

as 

as 

COMMENTS: 
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T 


MAGNETIC  COMPASS  TURN  (W-S;  270 


COMMENTS: 


RATE  CLIMB  (HOOD) 


INITIATE 


POWER  INCREASE  (RPM) 


-1QO 


-50  ^  +50 


+100 


AIRSPEED 


-10 


-5 


+5 


+10 


HEADING 


-10£ 


+5‘ 


+:oc 


MAINTAIN 


VERTICAL  SPEED  (FPM) 


-100 


-50  -  +50 


+100 


HEADING 


-10' 


-5 


+5' 


+10' 


LEVELOFF 


HEADING 


-10'* 

J 


-5°  +5°  +10° 

'  dhi  I _  L_ 


ASSIGNED  ALTITUDE 


-100 

J 


-50  ^  +50  +100 

_  L_ 


SMOOTH  CONTROL 


rrrrT  nm 


TURBULENCE 


DIO 


urr 


COMPOTS 


UNUSUAL  ATTiTUDE  RECOVERIES  (HOOD) 


RECOGNITION 

RECOGNITION  OF 

ATTITUDE 

tun 

pro"! 

RECOVERY 

- 

CORRECT  AND  TIMELY 

CONTROL  MOVEMENTS 

dm 

|“Wj 

INITIAL  ALTITUDE 

RECOVERED 

(!  100ft.) 

c?m 

prof 

HEADING  CONTROL  (RECOVERY) 

pTTf 

nm 

SMOOTH  CONTROL 

dm 

pROf 

TURBULENCE 

dm 

cm 

COMMENTS: 
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180°  TURKS  (HOOD) 


PROPER  ROLL IK 


am 


CM 


BANK  ANGLE 


ALTITUDE 


AIRSPEED 


ROLLOUT  OH 

ASSIGNED 

HEADING 


SMOOTH 

CONTROL 


cm 


rw] 


TURBULENCE 


CHS 


qetj 


VOR  TRACKING  {CROSS-COUNTRY;  INBOUND) 


IDENTIFICATION 
STATION  TUNED 


PROPERLY 

STATION  IDENTIFIED 

pT5“[ 

RADIAL  IDENTIFIED 

ALTITUDE 

-50  ^ 

.  +50 

(DURING  IDENTIFICATION) 

LAJ 

L_ 

HEADING 

(DURING  IDENTIFICATION) 

-10° 

_ l 

_C° 

+10° 

L_ 

TRACK  TO  STATION 

TURN  TO  INBOUND 
HEADING 


ALTITUDE 

-100  -50  A  +50 

1 

+100 

l 

AIRSPEED 

-10° 

1 

+C* 

+10° 

1 

VOR  TRACK 
(1  1  dot) 

am 

rw| 

TURBULENCE  QFT[  pW] 


COMMENTS: 
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TRAFFIC  PATTERN  {UNCONTROLLED  FIELD) 


ENTRY 

ANGLE  (45°) 

ABEAM  MIDPOINT 

ALTITUDE 

RPM 

DISTANCE  OUT 

DOWNWIND 

ALTITUDE 
COCKPIT  CHECK 
REDUCE  POWER 

AIRSPEED 
FLAPS  ( 10- ) 

PROPER  GROUND  TRACK 


cm 

cm 

prr| 

CM 

-100 

-50  +50 

.  i^l  . 

+100 

L 

-100 

_j 

-50  +50 

+100 

1 

TOO 

CLOSE 

_ 

TOO 

FAR 

-100  -50  +50  +100 

J _ UdlfrfeJ _ L 

cm  cm 

early  UdtehJ _ late 

-10  -5  +5  +10 

-.1 _ Infill  I  .  L 

nm  nun 

pm  rrn 


TURN  STARTED  (BASE) 


EARLY 


LATE 


j~TRAFFIC  PATTERN  (UNCONTROLLED  FIELD) 


BASE 


AIRSPEED  __ 

T 

+10 

L 

PROPER  GROUND  TRACK 

nm 

cm 

PROPER  FLAPS 

cm 

rm 

TURN  STARTED  (FINAL) 

EARLY 

LATE 

TRIM 

cm  c 

W] 

FINAL 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

Ui^L 

RIGHT 

AIRSPEED 

-10 

1 

-5  +5 

+10 

1 

DESCENT  RATE 

SLOW 

IdihfUi  1 

FAST 

APPROACH  ANGLE 

SHALLOW 

STEEP 

PROPER  FLAPS 

nm  r 

m 

TRIM  QTT[  rWT 


SMOOTH  CONTROL  pTC5~f  [~W| 

TURBULENCE  pTTf  | — WtT~f 


COMMENTS: 


TRAFFIC  PATTERN  (CONTROLLED  FIELD) 


ENTRY 


ANGLE  (45°) 


ABEAM  MIDPOINT 


ALTITUDE 


DISTANCE  OUT 


DOWNWIND 


ALTITUDE 


COCKPIT  CHECK 


REDUCE  POWER 


AIRSPEED 


FLAPS  (10°) 


PROPER  GROUND  TRACK 


TURN  STARTED  (BASE) 


TYPE  OF  ENTRY  (CHECK) 

□  DOWNWIND 

□  base 

|  f  FINAL 


prrr 

Qrri 


TOO 

CLOSE 


out 


EARLY 


□sa 
□ m 


EARLY 


rm 

rw i 


nm 


rm 

rm 
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JjTRAFFlC  PATTERN  {CONTROLLED  FIELD) 


BASE 


AIRSPEED 

PROPER  GROUND  TRACK 

PROPER  FLAPS 
TURN  STARTED  (FINAL) 


-IQ 


-5 


TO 

DEI 


EARLY 


+5 


+10 


rwt 

m 


LATE- 


TRIM 

rm 

FINAL 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

RIGHT 

-10 

-5  ^ 

tw  +5 

+10 

AIRSPEED 

1 

L^l 

1 

DESCENT 

SLOW 

FAST 

APPROACH  ANGLE 

SHALLOW 

STEEP 

PROPER  FLAPS 

Dm 

on 

TRIM 


dm 


rwr 


COMMENTS: 
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GO-AROUND  PROCEDURES  CORRECT 
THROTTLE  -  FULL  POWER 
PITCH  ATTITUDE  CHANGED 
CARB  HEAT  COLD 
FLAPS  20°  MAXIMUM 
CLIMB  55  KIAS  (1  5  KIAS) 
FLAPS  RETRACTED  PROPERLY 


nrs  i  rwn 


cm 


cm 


cm 


COMMENTS: 


NORMAL  LANDING  (UNCONTROLLED  FIELD) 


TRANSITION  (FLARE) 
ALTITUDE 


+10 

L 


PROPER  FLARE  RATE 

cm 

cm 

PROPER  FLARE  ATTITUDE 

PTT[ 

pun. 

TOUCHDOWN 

TOUCHDOWN  POINT  SHORT _ _ LONG 


PROPER  POWER 

ptri 

PROPER  NOSE 

ATTITUDE 

03 

CONTACT 

RUNWAY  CENTERLINE 
TRACK 


DROP 


BOUNCE 


LEFT 


I  RIGHT 

..  . 


SMOOTH  CONTROL 


TURBULENCE 


cm  cm 

cm  DEI 


COMMENTS: 


LANDING  (CONTROLLED  FIELD) 


t  | 

i  ; 


TRANSITION  (FLARE) 
ALTITUDE 


PROPER  FLARE  RATE 

prsj 

pro 1 

PROPER  FLARE  ATTITUDE 

fTtTJ 

nsn 

TOUCHDOWN 


TOUCHDOWN  POINT  SHORT  _ _ IdriftteaJ _  LONG 


PROPER  POWER 

rrETf  r 

urn 

PROPER  NOSE 

ATTITUDE 

REST  r 

UOj 

CONTACT 

DROP 

BOUNCE 

RUNWAY  CENTERLINE 

TRACK 

LEFT  UHStfU^sJ 

RIGHT 

SMOOTH  CONTROL  fTB'T  PUtTf 


TURBULENCE  [~TTsl  f~W] 


COMMENTS: 


A-4U 


SHORT  FIELD  LANDING  (TRANSITION  AND  TOUCHDOWN) 


TRANSITION  (FLARE) 


ALTITUDE 


20 

-5  ^  +5 


PROPER  FLARE  RATE 


rren 


nrc  1 


PROPER  FLARE  ATTITUDE 


[rrrf 


nmn 


TOUCHDOWN 


TOUCHDOWN  POINT 


SHORT 


PROPER  POWER 

PROPER  NOSE 
ATTITUDE 


TO 

tHH 


rm 

mu 


CONTACT 

RUNWAY  CENTERLINE 
TRACK 


BOUNCE 


RIGHT 


PROPER  USE  OF  BRAKES 


tun 


on 


SMOOTH  CONTROL 


DEO 


nm 


TURBULENCE 


SHORT  FIELD  LANDING  (BASE  AND  FINAL) 


BASE 

AIRSPEED  _ 

PROPER  GROUND  TRACK  (EXTENDED) 
PROPER  FLAPS 
TURN  STARTED  (FINAL) 

TRIM 


am 

am 


EARLY 


am 


rm 

am 


am 


TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

-10 

AIRSPEED 

I 

DESCENT  RATE 

SLOW 

APPROACH  ANGLE 

SHALLOW 

PROPER  FLAPS 

I 

STEEP 


CRC 


CROSSWIND  LANDING  (TRANSITION  AND  TOUCHDOWN) 


TRANSITION  (FLARE) 

ALTITUDE 

-10 

| 

20 

-5  a  +5  +10 

_ i  iffiti  1 _ L 

PROPER  FLARE  RATE 

tun 

cm 

PROPER  FLARE  ATTITUDE 

prrrt 

pnrf 

PROPER  DRIFT  CORRECTION 

am 

pun 

TOUCHDOWN 

TOUCHDOWN  POINT 

SHORT 

LONG 

PROPER  POWER 

am  c 

Trcrf 

PROPER  NOSE 

ATTITUDE 

am  c 

PROPER  DRIFT  CORRECTION 

am  c 

CONTACT 

DROP 

BOUNCE 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

L  k  te  nJ 

RIGHT 

r'ROPER  USE  OF  BRAKES 

am  c 

3g 

SMOOTH  CONTROL 

am  r 

i*g 

TURBULENCE  pTTf 


COMMENTS: 
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CROSSWIND  LANDING  (BASF.  AND  FINAL) 


x 


BASE 


-10 

-5  ^  +5 

+10 

AIRSPEED 

1 

! 

PROPER  GROUND  TRACK 

nm  rwi 

PROPER  FLAPS 

rrm  nm 

TURN  STARTED  (FINAL) 

EARLY 

Lulflftfc  1 

LATE 

TRIM 

m  nm 

FINAL 

PROPER  DRIFT  CORRECTION 

nisi  i  no  i 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

RIGHT 

AIRSPEED 

-10 
_  1 

-5  ^  +5 

. 

+10 

DESCENT  RATE 

SLOW 

FAST 

APPROACH  ANGLE 

SHALLOW 

STEEP 

PROPER  FLAPS 

[eh 

OH 

TRIM 

Dm 

OH 

ALL  AIRBORNE  COMMUNICATION  PROCEDURES 


ALL  FREQUENCIES  TUNED 

CORRECTLY  AND  PROMPTLY 

pTTf 

r*n 

PROPER  USE  Of  MIKE 

cm 

SPEAKS  CLEARLY 

rrcn 

pun 

MAKES  PROPER  REQUESTS 

03 

UNDERSTANDS  ALL  MESSAGES 

nm 

03 

COMPLIES  WITH  ALL  MESSAGES 

WHILE  PERFORMING  OTHER  TASKS 

03 

COMMENTS: 
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APPENDIX  B 


P RE  AND  POSTCHECK  QUESTIONNAIRES 


This  appendix  contains  copies  of  (1)  the  precheck  questionnaire,  which  asked 
students  to  predict  how  they  would  perform  on  the  8-month  retention  check;  and 
{Z)  the  postcheck  questionnaire,  which  asked  them  to  evaluate  their 
performance  after  they  had  completed  the  retention  check. 


B-l 


PHASE  CHECK:  III _ IV 

(cTrcTe  one)’ 


STUDENT  PRECHECK  QUESTIONNAIRE 


NAME: 


SOC.  SEC.  NO: 


This  questionnaire  Is  part  of  the  overall  experiment  of  which  your  training  Is 
a  part.  Objective  data  concerning  your  flight  skills  are  being  gathered 
through  the  use  of  the  phase  checks  with  which  you  are  already  familiar.  The 
purpose  of  this  questionnaire  Is  to  obtain  your  own  subjective  assessment  of 
your  skills.  This  assessment  will  be  compared  with  the  objective  measures 
obtained  during  the  phase  checks  and  with  subjective  ratings  you  will  make 
after  your  checkrlde  on  a  Postcheck  Questionnaire. 

The  data  obtained  from  these  questionnaires  will  aid  in  the  detennl nation  of 
the  abilities  of  private  pilots  to  assess  their  own  skills.  Such  a  deter¬ 
mination  is  of  great  importance  since  general  aviation  pilots,  once  they  have 
received  their  certificates,  must  be  able  (I)  to  judge  If  they  can  perform 
certain  flight  tasks  safely,  (2)  to  assess  the  adequacy  with  which  they  accom¬ 
plish  tasks  they  do  perform,  and  (3)  to  determine  when  they  need  refresher  or 
additional  training  to  Improve  their  skills.  Increased  understanding  of  the 
ability  of  general  aviation  pilots  to  make  these  judgments  will  aid  in  deter¬ 
mining  how  to  prevent  accidents  from  happening  In  which  pilots  attempt 
maneuvers  that  are  beyond  their  skill  levels. 

None  of  the  Instructors,  Including  the  one  who  is  administering  your  check- 
ride,  will  see  your  answers  to  this  or  the  Postcheck  Questionnaire.  Please  be 
frank  and  provide  honest  estimates  of  your  ability  to  perform  these  tasks. 

Please  rate  your  ability  to  perform  the  following  tasks,  using  the  7-polnt 
scale  provided  next  to  each  task.  Descriptive  statements  for  scale  points  1, 
3,  5,  and  7  are  as  follows: 

1.  I  will  probably  be  able  to  perform  the  task  with  NO  ERRORS. 

3.  I  will  probably  make  a  FEW  ERRORS,  but  I  will  perform  the  task  well 
enough  to  pass  It  easily  on  my  checkrlde. 

5.  I  will  probably  make  SEVERAL  ERRORS  and  barely  pass  the  task  on  rqy 
checkrlde. 

7.  I  will  probably  make  MANY  ERRORS  and  be  unable  to  perform  the  task 
satisfactorily  on  my  checkrlde. 
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Circle  the  number  that  best  Indicates  how  well  you  will  perform  each  task  on 
the  checkrlde  you  are  about  to  take. 


NO  FEW  SEVERAL  MANY 

TASKS  ERRORS  ERRORS  ERRORS  ERRORS 

1.  Planning  a  cross-country  trip  1  2  3  4  5  6  7 

2.  Conducting  an  engine  run  up  and  1  2  3  4  5  6  7 

before  takeoff  check 

3.  Taking  off  and  departing  from  1234507 
ACY 

4.  Tracking  a  VOR  signal  1  2  3  4  5  &  7 

5.  Flying  straight  and  level  1  2  3  4  5  <5  7 

6.  Flying  at  minimum  controllable  1  2  3  4  5  C  7 

airspeed 

7.  Performing  takeoff  and  departure  1  2  3  4  5  6  7 

stalls 

8.  Performing  approach  to  landing  1234567 

stalls 

9.  Performing  steep  turns  (720°)  1  2  3  4  5  6  ? 

10.  Performing  accelerated  stalls  1234567 

11.  Performing  engine  failure  1234667 

during  flight  procedures 

12.  Performing  forced  landing  1234567 

procedures 

13.  “erformlng  go-around  procedures  1234567 

14.  Flying  a  traffic  pattern  atanl  2  3  4  5  6  7 

uncontrolled  field 

15.  Making  a  normal  landing  at  an  1234  567 

uncontrolled  field 

16.  Making  short  field  takeoffs  1  2  3  4  5  6  7 

(uncontrolled  field) 

17.  Making  short  field  landings  1234567 

(uncontrolled  field) 
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TASKS 

Making  soft  field  takeoffs 
(uncontrolled  field) 

Making  crosswind  landings 
(uncontrolled  field) 

Making  crosswind  takeoffs 
(uncontrolled  field) 

Making  S  turns  across  a  road 

Making  turns  about  a  point 

Performing  a  rate  climb  under 
the  hood 

Performing  a  magnetic  compass 
turn  under  the  hood 

Performing  unusual  attitude 
recoveries  under  the  hood 

Performing  180°  turns  under  the 
hood 

Flying  a  traffic  pattern  at  a 
controlled  field  (ACY) 


NO 

ERRORS 

FEW 

ERRORS 

SEVERAL 

ERRORS 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

X 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

Making  a  normal  landing  at  ACY  1 

Performing  all  radio  communi¬ 
cation  tasks  1 


2 


3 


4 


5 


PHASE  CHECK:  III  IV 
(cTrcle  oneT 


STUDENT  POSTCHECK  QUESTIONNAIRE 


NAME: 


SQC.  SEC.  NO: 


Now  that  you  have  taken  your  checkrlde,  please  rate  your  performance  on  that 
flight  on  the  following  tasks  using  the  7-point  scale  beside  each  task. 
Descriptive  statements  for  scale  points  1,  3,  5,  and  /  are  as  follows: 

1.  I  performed  the  task  with  NO  ERRORS. 

3.  I  made  a  FEW  ERRORS,  but  probably  performed  the  task  well  enough  to 
pass  It  easily. 

5.  I  made  SEVERAL  ERRORS  and  probably  barely  passed  the  task. 

7.  I  made  MANY  ERRORS  and  probably  did  not  perform  the  task 
satisfactorily. 

Circle  the  nunber  that  best  Indicates  how  well  you  performed  each  of  the 
folTowi ng  tasks. 


NO 

TASKS  ERRORS 

FEW 

ERRORS 

SEVERAL 

ERRORS 

MANY 

ERRORS 

1. 

Planning  a  cross-country  trip 

1 

2 

3 

4 

5 

6 

7 

2. 

Conducting  an  engine  run  up 
and  before  takeoff  check 

1 

rt 

c. 

3 

4 

5 

6 

7 

3. 

Taking  off  and  departing  from 

ACY 

I 

2 

3 

4 

5 

6 

7 

4. 

Tracking  a  VOR  signal 

1 

2 

3 

4 

5 

6 

7 

5. 

Flying  straight  and  level 

1 

2 

3 

4 

5 

6 

7 

6. 

Flying  at  minlroun  controllable 
airspeed 

1 

2 

3 

4 

5 

6 

7 

7. 

Performing  takeoff  and  departure 
stall s 

1 

2 

3 

4 

5 

6 

7 

8. 

Performing  approach  to  landing 
stalls 

1 

2 

3 

4 

5 

6 

7 
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TASKS 


NO 

ERRORS 


TEW 

ERRORS 


SEVERAL 

ERRORS 


MANY 

ERRORS 


9. 

Performing  steep  turns  (720°) 

1 

2 

3 

4 

5 

6 

7 

10. 

Performing  accelerated  stalls 

1 

2 

3 

4 

b 

6 

7 

11. 

Performing  engine  failure 
during  flight  procedures 

1 

2 

3 

4 

5 

6 

7 

12. 

Performing  forced  landing 
procedures 

1 

2 

3 

4 

5 

6 

7 

13. 

Performing  go- around  procedures 

1 

2 

3 

4 

5 

6 

7 

14. 

Flying  a  traffic  pattern  at  an 
uncontrolled  field 

1 

2 

3 

4 

5 

6 

7 

15. 

Making  a  normal  landing  at  an 
uncontrolled  field 

1 

2 

3 

4 

5 

6 

7 

16. 

Making  short  field  takeoffs 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

17, 

Making  short  field  landings 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

18. 

Making  soft  field  takeoffs 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

19. 

Making  crosswind  landings 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

20. 

Making  crosswind  takeoffs 
(uncontrolled  field) 

1 

n 

3 

4 

5 

6 

7 

21. 

Making  S  turns  across  a  road 

1 

2 

3 

4 

5 

6 

7 

22. 

Making  turns  about  a  point 

1 

2 

3 

4 

5 

6 

7 

23. 

Performing  a  rate  climb  under 
the  hood 

1 

c 

3 

4 

5 

6 

7 

24, 

Performing  a  magnetic  compass 
turn  under  the  oood 

1 

2 

3 

4 

5 

6 

7 

25. 

Performing  unusual  attitude 
recoveries  under  the  hood 

1 

2 

3 

4 

5 

6 

7 

26. 

Performing  180°  turns  under  hood 

1 

2 

3 

4 

5 

6 

7 

TASKS 

NO 

FURORS 

FEW 

ERRORS 

SEVERAL 

ERRORS 

MANY 

ERRORS 

27. 

Flying  a  traffic  pattern  at  a 
controlled  field  { ACY > 

1 

2 

3 

4 

5 

6 

7 

28. 

Making  a  normal  landing  at  ACY 

1 

2 

3 

4 

5 

6 

7 

29. 

Performing  all  radio  communi¬ 
cation  tasks 

1 

2 

3 

4 

5 

6 

7 
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APPENDIX  C 


PRIVATE  PILOT  SURVEY 


TMs  appendix  contains  a  copy  of  the  Private  Pilot  Survey  that  was  used  to 
obtain  data  related  to  subjects'  flight  experience  since  certification.  These 
data  were  acquired  prior  to  each  retention  check  and  were  correlated  with 
flight  performance  data. 


C-l 


PRIVATE  PILOT  SURVEY 


NAME: 


SOC.  SEC.  NO. 


The  purpose  of  this  survey  Is  to  obtain  Information  concerning  your  flight 
experience  since  certification.  Your  answers  to  these  questions  will  be  used 
to  aid  In  Identifying  and  analyzing  factors  affecting  the  retention  of  private 
pilot  fl  ight  skill  s. 

Your  answers  to  questions  in  this  survey  will  renal n  anonymous.  That  Is, 
answers  given  by  specific  individuals  will  not  be  dl scussed  wl tin  Embry-Rlddle 
flight  instructors  or  FAA  personnel.  Your  name  Is  needed,  however,  to  enable 
the  Information  obtained  from  this  survey  to  be  analyzed  with  respect  to  other 
data  collected  during  this  study--e.g.,  flight  check  data. 


HOURS 


1.  How  many  total  hours  have  you  flown  {including  during  j 

your  private  pilot  training)?  j _ 

When  did  you  pass  the  FAA  flight  test? 

"Day  RonfTi - Tear 


a.  How  many  total  hours  have  you  flown  In  the 
interval  between  when  you  passed  the  FAa 
TTCght  test  arid" now? 

b.  How  many  flights  (log  entries)  did  you  make 
during  this  time  interval? 

c.  Identify  the  type  of  aircraft  you  have  flown 

in  the  interval  between  when  you  passed  the  FAA 
7TTght  test  and  now;  list  the  number  of  hours 
you  have  in  each  type.  (Write  on  back  If  you 
need  more  space.) 


4.  How  many  cross-country  hours  have  you  flown  in  the 
interval  between  when  you  passed  the  FAA  flight  test 
anPnow? 

5.  How  many  dual  hours  have  you  flown  in  the  Interval 
between  when" you  passed  the  FAA  fl  igftt  test  and  now? 

6.  How  many  hours  have  you  flown  while  receiving  "under- 
the-hood"  instructions  in  the  interval  between  when 
you  passed  the  FAA  fl  ig>it  test  ThlF  how? 


HOURS 


HOURS 


HOURS 

HOURS 

HOURS 

HOURS 


I  1K 


HOURS 

HOURS 


HOURS 


7.  How  many  hours  have  you  "flown"  in  simulators  or  other 
training  devices  in  the  interval  between  when  you 
passed  the  FAA  fl Ight  test- and  now? 


HOURS 


8.  Approximately  how  many  hours  have  you  flown  as  a 
passenger  (nonpilot)  in  a  general  aviation  aircraft 
(excluding  commuters  and  air  taxis)  in  the  Interval 
between  when  you  passed  the  FAA  fl  IghtTtest  and" now? 


HOURS 
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9.  Enter  the  approximate  mmber  of  total  hours  you 
have  flown  In  the  interval  between  when  you  passed 
the  FAA  flight  test  and  how  for  each  of  the 
following  reasons. 

a.  Pleasure  ( not  cross-country) 

b.  Transportation  (cross-country  for  business  or 
pleasure) 

c.  Instruction 

•  Refresher  training  or  other  training  that  is 
not  directed  toward  a  new  certificate  or  rating 


•  Multiengine  rating 


•  Instrument  (IFR  rating) 


e  Other  (describe) 


10.  When  was  the  last  time  you  flew? 

Day"*  Month  “Year- 

11.  When  was  the  next  to  the  last  time  you  flew?  _  _ 

Day  Ho  nth  “Tear " 

12.  How  often  do  you  regularly  fly?  (Circle  the  letter  of  the  best  answer.) 

a.  None 

b.  An  average  of  1-4  hours  a  month 

c.  An  average  of  5-10  hours  a  month 

d.  An  average  of  10-20  hours  a  month 

e.  An  average  of  more  than  20  hours  a  month 

13.  If  you  do  not  fly  as  often  as  you  would  like  to  fly*  please  circle  all  of 
the  reasons  you  do  not  fly. 

a.  High  costs 

b.  Lack  of  time 

c.  Would  rather  do  other  activities 

d.  Spouse  does  not  want  me  to  fly  more  often 

e.  Weather 

f.  Other  (describe) 
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14.  In  general,  how  much  has  your  flight  experience  aided  you  In  the  perfor¬ 
mance  of  your  job  at  the  Technical  Center? 

a.  Not  at  all 

b.  Very  little 

c .  A  1 1  ttl  e 

d.  A  moderate  amount 

e.  A  substantial  amount 

f.  A  extreme  amount 

15.  In  the  Interval  since  you  passed  your  FAA  flight  test,  on  what  percentage 
of  the  flights  that  you  have  flown  have  you  performed  the  following  tasks? 
Circle  the  mmber  which  best  indicates  the  percentage  of  flights  on  which 
you  performed  each  task.  If  you  have  not  flown  at  all,  leave  this 


question  blank. 

TASKS 

NEVER 

LESS 
THAN  10 
PERCENT 
OF  MY 
FLIGHTS 

10-50 
PERCENT 
OF  MY 
FLIGHTS 

50-90 
PERCENT 
OF  MY 
FLIGHTS 

90-100 
PERCENT 
OF  MY 
FLIGHTS 

Planning  a  cross-country  trip 

1 

2 

3 

4 

5 

Conducting  an  engine  run  up 
and  before  takeoff  check 

1 

2 

3 

A 

*T 

5 

Taking  off  and  departing  from 
ACY 

1 

2 

3 

4 

5 

Tracking  a  VOR  signal 

1 

2 

3 

4 

5 

Flying  straight  and  level 

1 

2 

3 

4 

5 

Flying  at  minimum  controllable 
airspeed 

1 

2 

3 

4 

5 

Performing  takeoff  and 
departure  stalls 

1 

2 

3 

4 

5 

Performing  approach  to  landing 
stal 1 s 

I 

2 

3 

4 

5 

Performing  steep  turns  (720°) 

1 

2 

3 

4 

5 

Performing  accelerated  stalls 

1 

2 

3 

4 

5 

Performing  engine  failure 
procedures  during  flight 

1 

2 

3 

4 

5 

Performing  forced  landing 

1 

2 

3 

4 

5 

procedures 


TASKS  NEVER 

Performing  go- around  procedures  1 


Flying  a  traffic  pattern  at  an  1 
uncontrolled  field 

Making  a  normal  landing  at  an  1 

uncontrolled  field 

Making  short  field  takeoffs  1 

(uncontrolled  field) 

Making  soft  field  takeoffs  1 

(uncontrolled  field) 

Making  crosswind  landings  1 


(uncontrolled  field) 

Making  crosswind  takeoffs 
(uncontrolled  field) 


Making  S  turns  across  a  road  1 

Making  turns  about  a  point  1 

Performing  a  rate  climb  under  1 
the  hood 

Performing  a  magnetic  compass  1 

turn  under  the  hood 

Performing  180°  turns  under  1 

the  hood 

Flying  a  traffic  pattern  at  a  1 
controlled  field 

Making  a  normal  landing  at  a  1 

controlled  field 

Performing  all  radio  1 

communications  tasks 


LESS 

THAN  10 

10-50 

50-90 

90-100 

PERCENT 

PERCENT 

PERCENT 

PERCENT 

OF  MY 

OF  MY 

OF  MY 

OF  MY 

FLIGHTS 

FLIGHTS 

FLIGHTS 

FLIGHTS 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

a 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

2 

3 

4 

5 

C-6 


